2023-07-22 22:06:04,846 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-22 22:06:05,082 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85 2023-07-22 22:06:05,082 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-22 22:06:05,082 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-22 22:06:05,116 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 22:06:05,361 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 22:06:05,361 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9, deleteOnExit=true 2023-07-22 22:06:05,361 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 22:06:05,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/test.cache.data in system properties and HBase conf 2023-07-22 22:06:05,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 22:06:05,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop.log.dir in system properties and HBase conf 2023-07-22 22:06:05,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 22:06:05,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 22:06:05,364 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 22:06:05,688 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 22:06:05,696 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:05,697 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:05,697 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 22:06:05,698 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:05,698 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 22:06:05,699 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 22:06:05,702 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:05,703 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:05,704 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 22:06:05,704 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/nfs.dump.dir in system properties and HBase conf 2023-07-22 22:06:05,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir in system properties and HBase conf 2023-07-22 22:06:05,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:05,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 22:06:05,706 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 22:06:06,343 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 22:06:06,347 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 22:06:06,621 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 22:06:06,804 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 22:06:06,831 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:06,865 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:06,900 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_localhost_45251_hdfs____koiac7/webapp 2023-07-22 22:06:07,048 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45251 2023-07-22 22:06:07,095 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 22:06:07,096 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 22:06:07,599 WARN [Listener at localhost/35247] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:07,717 WARN [Listener at localhost/35247] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 22:06:07,742 WARN [Listener at localhost/35247] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:07,750 INFO [Listener at localhost/35247] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:07,755 INFO [Listener at localhost/35247] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_localhost_37121_datanode____61kx83/webapp 2023-07-22 22:06:07,873 INFO [Listener at localhost/35247] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37121 2023-07-22 22:06:08,477 WARN [Listener at localhost/46171] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:08,521 WARN [Listener at localhost/46171] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 22:06:08,526 WARN [Listener at localhost/46171] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:08,529 INFO [Listener at localhost/46171] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:08,535 INFO [Listener at localhost/46171] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_localhost_37095_datanode____.pskss1/webapp 2023-07-22 22:06:08,663 INFO [Listener at localhost/46171] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37095 2023-07-22 22:06:08,691 WARN [Listener at localhost/39363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:08,753 WARN [Listener at localhost/39363] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 22:06:08,758 WARN [Listener at localhost/39363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:08,761 INFO [Listener at localhost/39363] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:08,772 INFO [Listener at localhost/39363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_localhost_41521_datanode____.ya1qf6/webapp 2023-07-22 22:06:08,935 INFO [Listener at localhost/39363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41521 2023-07-22 22:06:08,975 WARN [Listener at localhost/36705] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:09,341 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d9fbdf5a389ef81: Processing first storage report for DS-f6e87396-1cde-4ac0-a26c-05986f69bf69 from datanode 6867b3b2-dbc8-444a-bf77-95f5c2a843cc 2023-07-22 22:06:09,343 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d9fbdf5a389ef81: from storage DS-f6e87396-1cde-4ac0-a26c-05986f69bf69 node DatanodeRegistration(127.0.0.1:36609, datanodeUuid=6867b3b2-dbc8-444a-bf77-95f5c2a843cc, infoPort=46699, infoSecurePort=0, ipcPort=39363, storageInfo=lv=-57;cid=testClusterID;nsid=877749322;c=1690063566419), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,343 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc8aaf928b84f7669: Processing first storage report for DS-3c08d543-725c-40cb-8677-c3f7673fac63 from datanode 0bbb2eea-585a-46ef-becb-74848c55a7c7 2023-07-22 22:06:09,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc8aaf928b84f7669: from storage DS-3c08d543-725c-40cb-8677-c3f7673fac63 node DatanodeRegistration(127.0.0.1:45219, datanodeUuid=0bbb2eea-585a-46ef-becb-74848c55a7c7, infoPort=41209, infoSecurePort=0, ipcPort=36705, storageInfo=lv=-57;cid=testClusterID;nsid=877749322;c=1690063566419), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,344 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d9fbdf5a389ef81: Processing first storage report for DS-22dac565-6b9b-4e02-9e4d-3d0cf34b2af0 from datanode 6867b3b2-dbc8-444a-bf77-95f5c2a843cc 2023-07-22 22:06:09,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d9fbdf5a389ef81: from storage DS-22dac565-6b9b-4e02-9e4d-3d0cf34b2af0 node DatanodeRegistration(127.0.0.1:36609, datanodeUuid=6867b3b2-dbc8-444a-bf77-95f5c2a843cc, infoPort=46699, infoSecurePort=0, ipcPort=39363, storageInfo=lv=-57;cid=testClusterID;nsid=877749322;c=1690063566419), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,344 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc8aaf928b84f7669: Processing first storage report for DS-6245c4df-96b2-4e30-b2bb-48ddfb4ddb37 from datanode 0bbb2eea-585a-46ef-becb-74848c55a7c7 2023-07-22 22:06:09,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc8aaf928b84f7669: from storage DS-6245c4df-96b2-4e30-b2bb-48ddfb4ddb37 node DatanodeRegistration(127.0.0.1:45219, datanodeUuid=0bbb2eea-585a-46ef-becb-74848c55a7c7, infoPort=41209, infoSecurePort=0, ipcPort=36705, storageInfo=lv=-57;cid=testClusterID;nsid=877749322;c=1690063566419), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,345 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbbb42128a67eaa24: Processing first storage report for DS-8d117130-03e5-4594-b1df-2a01f2cf3adf from datanode b26addf9-35fd-4b6d-826b-589a0fdba03e 2023-07-22 22:06:09,345 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbbb42128a67eaa24: from storage DS-8d117130-03e5-4594-b1df-2a01f2cf3adf node DatanodeRegistration(127.0.0.1:35507, datanodeUuid=b26addf9-35fd-4b6d-826b-589a0fdba03e, infoPort=46813, infoSecurePort=0, ipcPort=46171, storageInfo=lv=-57;cid=testClusterID;nsid=877749322;c=1690063566419), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,345 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbbb42128a67eaa24: Processing first storage report for DS-93b8d81c-f6a8-4386-87e2-8b7829af0302 from datanode b26addf9-35fd-4b6d-826b-589a0fdba03e 2023-07-22 22:06:09,345 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbbb42128a67eaa24: from storage DS-93b8d81c-f6a8-4386-87e2-8b7829af0302 node DatanodeRegistration(127.0.0.1:35507, datanodeUuid=b26addf9-35fd-4b6d-826b-589a0fdba03e, infoPort=46813, infoSecurePort=0, ipcPort=46171, storageInfo=lv=-57;cid=testClusterID;nsid=877749322;c=1690063566419), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,519 DEBUG [Listener at localhost/36705] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85 2023-07-22 22:06:09,594 INFO [Listener at localhost/36705] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/zookeeper_0, clientPort=62392, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 22:06:09,616 INFO [Listener at localhost/36705] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62392 2023-07-22 22:06:09,628 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:09,630 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:10,358 INFO [Listener at localhost/36705] util.FSUtils(471): Created version file at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 with version=8 2023-07-22 22:06:10,359 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/hbase-staging 2023-07-22 22:06:10,751 INFO [Listener at localhost/36705] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 22:06:11,357 INFO [Listener at localhost/36705] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:11,403 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:11,403 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:11,404 INFO [Listener at localhost/36705] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:11,404 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:11,404 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:11,577 INFO [Listener at localhost/36705] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:11,670 DEBUG [Listener at localhost/36705] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 22:06:11,778 INFO [Listener at localhost/36705] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41269 2023-07-22 22:06:11,794 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:11,796 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:11,818 INFO [Listener at localhost/36705] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41269 connecting to ZooKeeper ensemble=127.0.0.1:62392 2023-07-22 22:06:11,867 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:412690x0, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:11,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41269-0x1018f1205ab0000 connected 2023-07-22 22:06:11,908 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:11,909 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:11,925 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:11,937 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41269 2023-07-22 22:06:11,937 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41269 2023-07-22 22:06:11,938 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41269 2023-07-22 22:06:11,939 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41269 2023-07-22 22:06:11,939 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41269 2023-07-22 22:06:11,946 INFO [Listener at localhost/36705] master.HMaster(444): hbase.rootdir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, hbase.cluster.distributed=false 2023-07-22 22:06:12,017 INFO [Listener at localhost/36705] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:12,017 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,017 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,017 INFO [Listener at localhost/36705] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:12,018 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,018 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:12,022 INFO [Listener at localhost/36705] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:12,026 INFO [Listener at localhost/36705] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45315 2023-07-22 22:06:12,030 INFO [Listener at localhost/36705] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 22:06:12,039 INFO [Listener at localhost/36705] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 22:06:12,040 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,042 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,045 INFO [Listener at localhost/36705] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45315 connecting to ZooKeeper ensemble=127.0.0.1:62392 2023-07-22 22:06:12,051 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:453150x0, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:12,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45315-0x1018f1205ab0001 connected 2023-07-22 22:06:12,052 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:12,054 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:12,055 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,058 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45315 2023-07-22 22:06:12,059 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45315 2023-07-22 22:06:12,062 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45315 2023-07-22 22:06:12,066 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45315 2023-07-22 22:06:12,068 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45315 2023-07-22 22:06:12,087 INFO [Listener at localhost/36705] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:12,087 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,088 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,088 INFO [Listener at localhost/36705] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:12,089 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,089 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:12,089 INFO [Listener at localhost/36705] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:12,092 INFO [Listener at localhost/36705] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33875 2023-07-22 22:06:12,092 INFO [Listener at localhost/36705] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 22:06:12,093 INFO [Listener at localhost/36705] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 22:06:12,094 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,096 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,098 INFO [Listener at localhost/36705] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33875 connecting to ZooKeeper ensemble=127.0.0.1:62392 2023-07-22 22:06:12,108 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:338750x0, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:12,110 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:338750x0, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:12,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33875-0x1018f1205ab0002 connected 2023-07-22 22:06:12,111 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:12,112 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,125 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33875 2023-07-22 22:06:12,126 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33875 2023-07-22 22:06:12,126 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33875 2023-07-22 22:06:12,132 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33875 2023-07-22 22:06:12,135 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33875 2023-07-22 22:06:12,153 INFO [Listener at localhost/36705] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:12,154 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,154 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,154 INFO [Listener at localhost/36705] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:12,154 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,154 INFO [Listener at localhost/36705] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:12,155 INFO [Listener at localhost/36705] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:12,160 INFO [Listener at localhost/36705] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37263 2023-07-22 22:06:12,160 INFO [Listener at localhost/36705] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 22:06:12,164 INFO [Listener at localhost/36705] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 22:06:12,165 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,167 INFO [Listener at localhost/36705] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,169 INFO [Listener at localhost/36705] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37263 connecting to ZooKeeper ensemble=127.0.0.1:62392 2023-07-22 22:06:12,174 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:372630x0, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:12,175 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:372630x0, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:12,176 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:372630x0, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:12,178 DEBUG [Listener at localhost/36705] zookeeper.ZKUtil(164): regionserver:372630x0, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37263-0x1018f1205ab0003 connected 2023-07-22 22:06:12,183 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37263 2023-07-22 22:06:12,183 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37263 2023-07-22 22:06:12,186 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37263 2023-07-22 22:06:12,195 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37263 2023-07-22 22:06:12,196 DEBUG [Listener at localhost/36705] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37263 2023-07-22 22:06:12,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:12,209 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 22:06:12,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:12,237 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,237 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,237 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,238 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,239 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:12,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 22:06:12,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 22:06:12,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41269,1690063570541 from backup master directory 2023-07-22 22:06:12,250 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:12,250 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 22:06:12,251 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:12,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:12,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 22:06:12,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 22:06:12,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/hbase.id with ID: 256aded1-3d47-4cf0-9ea2-9f1132ba82ec 2023-07-22 22:06:12,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:12,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x32c275b9 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:12,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8fd8ea7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:12,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:12,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 22:06:12,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 22:06:12,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 22:06:12,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 22:06:12,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 22:06:12,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:12,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store-tmp 2023-07-22 22:06:12,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:12,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 22:06:12,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:12,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:12,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 22:06:12,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:12,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:12,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 22:06:12,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/WALs/jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:12,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41269%2C1690063570541, suffix=, logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/WALs/jenkins-hbase4.apache.org,41269,1690063570541, archiveDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/oldWALs, maxLogs=10 2023-07-22 22:06:12,797 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK] 2023-07-22 22:06:12,797 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK] 2023-07-22 22:06:12,797 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK] 2023-07-22 22:06:12,806 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 22:06:12,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/WALs/jenkins-hbase4.apache.org,41269,1690063570541/jenkins-hbase4.apache.org%2C41269%2C1690063570541.1690063572751 2023-07-22 22:06:12,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK], DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK]] 2023-07-22 22:06:12,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:12,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:12,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:12,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:12,981 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:12,989 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 22:06:13,022 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 22:06:13,036 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:13,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:13,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62602373, jitterRate=-0.06715194880962372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:13,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 22:06:13,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 22:06:13,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 22:06:13,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 22:06:13,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 22:06:13,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 22:06:13,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 55 msec 2023-07-22 22:06:13,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 22:06:13,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 22:06:13,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 22:06:13,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 22:06:13,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 22:06:13,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 22:06:13,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 22:06:13,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 22:06:13,281 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 22:06:13,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 22:06:13,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 22:06:13,312 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,312 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,312 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,312 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,312 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41269,1690063570541, sessionid=0x1018f1205ab0000, setting cluster-up flag (Was=false) 2023-07-22 22:06:13,336 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 22:06:13,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:13,354 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 22:06:13,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:13,366 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp 2023-07-22 22:06:13,401 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(951): ClusterId : 256aded1-3d47-4cf0-9ea2-9f1132ba82ec 2023-07-22 22:06:13,404 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(951): ClusterId : 256aded1-3d47-4cf0-9ea2-9f1132ba82ec 2023-07-22 22:06:13,406 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(951): ClusterId : 256aded1-3d47-4cf0-9ea2-9f1132ba82ec 2023-07-22 22:06:13,410 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 22:06:13,411 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 22:06:13,411 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 22:06:13,418 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 22:06:13,418 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 22:06:13,418 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 22:06:13,418 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 22:06:13,418 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 22:06:13,418 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 22:06:13,429 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 22:06:13,439 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 22:06:13,439 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 22:06:13,443 DEBUG [RS:1;jenkins-hbase4:33875] zookeeper.ReadOnlyZKClient(139): Connect 0x075c5045 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:13,444 DEBUG [RS:0;jenkins-hbase4:45315] zookeeper.ReadOnlyZKClient(139): Connect 0x75ded087 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:13,447 DEBUG [RS:2;jenkins-hbase4:37263] zookeeper.ReadOnlyZKClient(139): Connect 0x3f7f689a to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:13,475 DEBUG [RS:0;jenkins-hbase4:45315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@333d3cda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:13,477 DEBUG [RS:0;jenkins-hbase4:45315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2986c78f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:06:13,481 DEBUG [RS:1;jenkins-hbase4:33875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425ececa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:13,482 DEBUG [RS:1;jenkins-hbase4:33875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e0f3827, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:06:13,495 DEBUG [RS:2;jenkins-hbase4:37263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a7df111, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:13,495 DEBUG [RS:2;jenkins-hbase4:37263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77e825e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:06:13,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 22:06:13,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:13,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 22:06:13,511 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45315 2023-07-22 22:06:13,515 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33875 2023-07-22 22:06:13,518 INFO [RS:0;jenkins-hbase4:45315] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 22:06:13,518 INFO [RS:0;jenkins-hbase4:45315] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 22:06:13,519 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 22:06:13,519 INFO [RS:1;jenkins-hbase4:33875] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 22:06:13,520 INFO [RS:1;jenkins-hbase4:33875] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 22:06:13,520 INFO [RS:0;jenkins-hbase4:45315] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:13,523 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 22:06:13,523 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 22:06:13,523 INFO [RS:1;jenkins-hbase4:33875] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:13,523 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 22:06:13,527 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41269,1690063570541 with isa=jenkins-hbase4.apache.org/172.31.14.131:45315, startcode=1690063572016 2023-07-22 22:06:13,527 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41269,1690063570541 with isa=jenkins-hbase4.apache.org/172.31.14.131:33875, startcode=1690063572086 2023-07-22 22:06:13,550 DEBUG [RS:1;jenkins-hbase4:33875] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 22:06:13,552 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:37263 2023-07-22 22:06:13,550 DEBUG [RS:0;jenkins-hbase4:45315] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 22:06:13,553 INFO [RS:2;jenkins-hbase4:37263] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 22:06:13,553 INFO [RS:2;jenkins-hbase4:37263] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 22:06:13,553 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 22:06:13,553 INFO [RS:2;jenkins-hbase4:37263] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:13,553 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 22:06:13,555 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41269,1690063570541 with isa=jenkins-hbase4.apache.org/172.31.14.131:37263, startcode=1690063572153 2023-07-22 22:06:13,555 DEBUG [RS:2;jenkins-hbase4:37263] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 22:06:13,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 22:06:13,624 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39287, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 22:06:13,625 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60029, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 22:06:13,624 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44411, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 22:06:13,637 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41269] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 22:06:13,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:13,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:13,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:13,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:13,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 22:06:13,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:13,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:13,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:13,648 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41269] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 22:06:13,649 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41269] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 22:06:13,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690063603655 2023-07-22 22:06:13,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 22:06:13,669 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 22:06:13,669 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 22:06:13,676 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 22:06:13,676 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 22:06:13,676 WARN [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 22:06:13,676 WARN [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 22:06:13,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 22:06:13,678 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:13,683 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 22:06:13,683 WARN [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 22:06:13,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 22:06:13,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 22:06:13,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 22:06:13,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 22:06:13,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 22:06:13,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 22:06:13,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 22:06:13,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 22:06:13,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 22:06:13,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690063573709,5,FailOnTimeoutGroup] 2023-07-22 22:06:13,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690063573711,5,FailOnTimeoutGroup] 2023-07-22 22:06:13,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 22:06:13,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,732 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:13,734 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:13,734 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:13,777 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41269,1690063570541 with isa=jenkins-hbase4.apache.org/172.31.14.131:33875, startcode=1690063572086 2023-07-22 22:06:13,778 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41269,1690063570541 with isa=jenkins-hbase4.apache.org/172.31.14.131:37263, startcode=1690063572153 2023-07-22 22:06:13,780 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:13,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 22:06:13,786 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41269,1690063570541 with isa=jenkins-hbase4.apache.org/172.31.14.131:45315, startcode=1690063572016 2023-07-22 22:06:13,789 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41269] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:13,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/info 2023-07-22 22:06:13,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 22:06:13,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:13,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 22:06:13,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/rep_barrier 2023-07-22 22:06:13,796 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 22:06:13,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:13,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 22:06:13,800 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41269] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:13,801 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:13,802 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35247 2023-07-22 22:06:13,802 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 22:06:13,802 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:13,802 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35247 2023-07-22 22:06:13,803 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 22:06:13,803 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41269] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:13,804 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:13,804 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35247 2023-07-22 22:06:13,805 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 22:06:13,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/table 2023-07-22 22:06:13,812 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 22:06:13,812 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:06:13,813 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:13,816 DEBUG [RS:0;jenkins-hbase4:45315] zookeeper.ZKUtil(162): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:13,816 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740 2023-07-22 22:06:13,816 WARN [RS:0;jenkins-hbase4:45315] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:13,816 DEBUG [RS:1;jenkins-hbase4:33875] zookeeper.ZKUtil(162): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:13,816 INFO [RS:0;jenkins-hbase4:45315] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:13,817 WARN [RS:1;jenkins-hbase4:33875] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:13,819 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:13,820 DEBUG [RS:2;jenkins-hbase4:37263] zookeeper.ZKUtil(162): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:13,820 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740 2023-07-22 22:06:13,820 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37263,1690063572153] 2023-07-22 22:06:13,819 INFO [RS:1;jenkins-hbase4:33875] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:13,822 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33875,1690063572086] 2023-07-22 22:06:13,821 WARN [RS:2;jenkins-hbase4:37263] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:13,822 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:13,822 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45315,1690063572016] 2023-07-22 22:06:13,822 INFO [RS:2;jenkins-hbase4:37263] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:13,827 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:13,830 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 22:06:13,857 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 22:06:13,867 DEBUG [RS:2;jenkins-hbase4:37263] zookeeper.ZKUtil(162): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:13,868 DEBUG [RS:2;jenkins-hbase4:37263] zookeeper.ZKUtil(162): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:13,868 DEBUG [RS:2;jenkins-hbase4:37263] zookeeper.ZKUtil(162): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:13,874 DEBUG [RS:1;jenkins-hbase4:33875] zookeeper.ZKUtil(162): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:13,874 DEBUG [RS:1;jenkins-hbase4:33875] zookeeper.ZKUtil(162): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:13,875 DEBUG [RS:1;jenkins-hbase4:33875] zookeeper.ZKUtil(162): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:13,885 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:13,886 DEBUG [RS:0;jenkins-hbase4:45315] zookeeper.ZKUtil(162): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:13,886 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71510954, jitterRate=0.06559625267982483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 22:06:13,886 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 22:06:13,887 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 22:06:13,887 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 22:06:13,887 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 22:06:13,887 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 22:06:13,887 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 22:06:13,888 DEBUG [RS:0;jenkins-hbase4:45315] zookeeper.ZKUtil(162): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:13,889 DEBUG [RS:0;jenkins-hbase4:45315] zookeeper.ZKUtil(162): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:13,898 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 22:06:13,899 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 22:06:13,899 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 22:06:13,898 DEBUG [RS:1;jenkins-hbase4:33875] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 22:06:13,907 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 22:06:13,912 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 22:06:13,912 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 22:06:13,917 INFO [RS:0;jenkins-hbase4:45315] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 22:06:13,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 22:06:13,933 INFO [RS:2;jenkins-hbase4:37263] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 22:06:13,932 INFO [RS:1;jenkins-hbase4:33875] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 22:06:13,960 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 22:06:13,963 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 22:06:13,980 INFO [RS:1;jenkins-hbase4:33875] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 22:06:13,980 INFO [RS:0;jenkins-hbase4:45315] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 22:06:13,982 INFO [RS:2;jenkins-hbase4:37263] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 22:06:13,987 INFO [RS:2;jenkins-hbase4:37263] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 22:06:13,987 INFO [RS:0;jenkins-hbase4:45315] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 22:06:13,988 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,987 INFO [RS:1;jenkins-hbase4:33875] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 22:06:13,988 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,989 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:13,990 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 22:06:13,990 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 22:06:13,992 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 22:06:14,002 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,002 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,002 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,003 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,002 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,003 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,003 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,004 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,005 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,005 DEBUG [RS:1;jenkins-hbase4:33875] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,005 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,006 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,006 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,006 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,006 DEBUG [RS:0;jenkins-hbase4:45315] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,006 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,006 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,006 DEBUG [RS:2;jenkins-hbase4:37263] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,018 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,019 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,019 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,019 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,019 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,019 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,035 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,035 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,035 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,038 INFO [RS:2;jenkins-hbase4:37263] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 22:06:14,042 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37263,1690063572153-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,038 INFO [RS:1;jenkins-hbase4:33875] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 22:06:14,071 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33875,1690063572086-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,062 INFO [RS:0;jenkins-hbase4:45315] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 22:06:14,071 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45315,1690063572016-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,094 INFO [RS:1;jenkins-hbase4:33875] regionserver.Replication(203): jenkins-hbase4.apache.org,33875,1690063572086 started 2023-07-22 22:06:14,094 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33875,1690063572086, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33875, sessionid=0x1018f1205ab0002 2023-07-22 22:06:14,094 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 22:06:14,094 DEBUG [RS:1;jenkins-hbase4:33875] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:14,094 DEBUG [RS:1;jenkins-hbase4:33875] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33875,1690063572086' 2023-07-22 22:06:14,094 DEBUG [RS:1;jenkins-hbase4:33875] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 22:06:14,095 DEBUG [RS:1;jenkins-hbase4:33875] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 22:06:14,095 INFO [RS:2;jenkins-hbase4:37263] regionserver.Replication(203): jenkins-hbase4.apache.org,37263,1690063572153 started 2023-07-22 22:06:14,095 INFO [RS:0;jenkins-hbase4:45315] regionserver.Replication(203): jenkins-hbase4.apache.org,45315,1690063572016 started 2023-07-22 22:06:14,096 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45315,1690063572016, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45315, sessionid=0x1018f1205ab0001 2023-07-22 22:06:14,096 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 22:06:14,096 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37263,1690063572153, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37263, sessionid=0x1018f1205ab0003 2023-07-22 22:06:14,097 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 22:06:14,097 DEBUG [RS:2;jenkins-hbase4:37263] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:14,097 DEBUG [RS:2;jenkins-hbase4:37263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37263,1690063572153' 2023-07-22 22:06:14,098 DEBUG [RS:2;jenkins-hbase4:37263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 22:06:14,099 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 22:06:14,099 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 22:06:14,099 DEBUG [RS:1;jenkins-hbase4:33875] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:14,096 DEBUG [RS:0;jenkins-hbase4:45315] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:14,101 DEBUG [RS:0;jenkins-hbase4:45315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45315,1690063572016' 2023-07-22 22:06:14,102 DEBUG [RS:0;jenkins-hbase4:45315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 22:06:14,101 DEBUG [RS:2;jenkins-hbase4:37263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 22:06:14,101 DEBUG [RS:1;jenkins-hbase4:33875] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33875,1690063572086' 2023-07-22 22:06:14,102 DEBUG [RS:1;jenkins-hbase4:33875] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:14,103 DEBUG [RS:1;jenkins-hbase4:33875] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:14,103 DEBUG [RS:0;jenkins-hbase4:45315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 22:06:14,103 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 22:06:14,103 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 22:06:14,103 DEBUG [RS:2;jenkins-hbase4:37263] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:14,104 DEBUG [RS:2;jenkins-hbase4:37263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37263,1690063572153' 2023-07-22 22:06:14,104 DEBUG [RS:2;jenkins-hbase4:37263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:14,104 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 22:06:14,104 DEBUG [RS:1;jenkins-hbase4:33875] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 22:06:14,104 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 22:06:14,105 INFO [RS:1;jenkins-hbase4:33875] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 22:06:14,105 DEBUG [RS:0;jenkins-hbase4:45315] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:14,105 DEBUG [RS:0;jenkins-hbase4:45315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45315,1690063572016' 2023-07-22 22:06:14,105 DEBUG [RS:0;jenkins-hbase4:45315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:14,105 INFO [RS:1;jenkins-hbase4:33875] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 22:06:14,105 DEBUG [RS:2;jenkins-hbase4:37263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:14,106 DEBUG [RS:0;jenkins-hbase4:45315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:14,106 DEBUG [RS:2;jenkins-hbase4:37263] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 22:06:14,106 INFO [RS:2;jenkins-hbase4:37263] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 22:06:14,107 INFO [RS:2;jenkins-hbase4:37263] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 22:06:14,108 DEBUG [RS:0;jenkins-hbase4:45315] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 22:06:14,108 INFO [RS:0;jenkins-hbase4:45315] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 22:06:14,108 INFO [RS:0;jenkins-hbase4:45315] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 22:06:14,116 DEBUG [jenkins-hbase4:41269] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-22 22:06:14,122 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:14,131 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:14,131 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:14,131 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:14,132 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:14,136 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45315,1690063572016, state=OPENING 2023-07-22 22:06:14,147 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 22:06:14,148 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:14,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:14,154 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 22:06:14,221 INFO [RS:2;jenkins-hbase4:37263] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37263%2C1690063572153, suffix=, logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,37263,1690063572153, archiveDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs, maxLogs=32 2023-07-22 22:06:14,221 INFO [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45315%2C1690063572016, suffix=, logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,45315,1690063572016, archiveDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs, maxLogs=32 2023-07-22 22:06:14,222 INFO [RS:1;jenkins-hbase4:33875] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33875%2C1690063572086, suffix=, logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,33875,1690063572086, archiveDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs, maxLogs=32 2023-07-22 22:06:14,283 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK] 2023-07-22 22:06:14,283 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK] 2023-07-22 22:06:14,293 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK] 2023-07-22 22:06:14,329 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK] 2023-07-22 22:06:14,335 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK] 2023-07-22 22:06:14,335 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK] 2023-07-22 22:06:14,336 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK] 2023-07-22 22:06:14,335 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK] 2023-07-22 22:06:14,336 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK] 2023-07-22 22:06:14,356 INFO [RS:2;jenkins-hbase4:37263] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,37263,1690063572153/jenkins-hbase4.apache.org%2C37263%2C1690063572153.1690063574228 2023-07-22 22:06:14,356 INFO [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,45315,1690063572016/jenkins-hbase4.apache.org%2C45315%2C1690063572016.1690063574228 2023-07-22 22:06:14,356 INFO [RS:1;jenkins-hbase4:33875] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,33875,1690063572086/jenkins-hbase4.apache.org%2C33875%2C1690063572086.1690063574228 2023-07-22 22:06:14,357 DEBUG [RS:2;jenkins-hbase4:37263] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK], DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK]] 2023-07-22 22:06:14,357 DEBUG [RS:1;jenkins-hbase4:33875] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK], DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK]] 2023-07-22 22:06:14,357 DEBUG [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK], DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK]] 2023-07-22 22:06:14,393 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:14,400 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:06:14,405 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:06:14,422 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 22:06:14,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:14,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45315%2C1690063572016.meta, suffix=.meta, logDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,45315,1690063572016, archiveDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs, maxLogs=32 2023-07-22 22:06:14,456 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK] 2023-07-22 22:06:14,458 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK] 2023-07-22 22:06:14,459 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK] 2023-07-22 22:06:14,484 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/WALs/jenkins-hbase4.apache.org,45315,1690063572016/jenkins-hbase4.apache.org%2C45315%2C1690063572016.meta.1690063574429.meta 2023-07-22 22:06:14,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36609,DS-f6e87396-1cde-4ac0-a26c-05986f69bf69,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-8d117130-03e5-4594-b1df-2a01f2cf3adf,DISK], DatanodeInfoWithStorage[127.0.0.1:45219,DS-3c08d543-725c-40cb-8677-c3f7673fac63,DISK]] 2023-07-22 22:06:14,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:14,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 22:06:14,495 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:14,496 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 22:06:14,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 22:06:14,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 22:06:14,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 22:06:14,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:14,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 22:06:14,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 22:06:14,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 22:06:14,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/info 2023-07-22 22:06:14,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/info 2023-07-22 22:06:14,526 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 22:06:14,527 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:14,527 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 22:06:14,529 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/rep_barrier 2023-07-22 22:06:14,529 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/rep_barrier 2023-07-22 22:06:14,530 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 22:06:14,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:14,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 22:06:14,544 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/table 2023-07-22 22:06:14,544 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/table 2023-07-22 22:06:14,545 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 22:06:14,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:14,549 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740 2023-07-22 22:06:14,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740 2023-07-22 22:06:14,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 22:06:14,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 22:06:14,561 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71064647, jitterRate=0.05894576013088226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 22:06:14,565 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 22:06:14,590 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690063574375 2023-07-22 22:06:14,654 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 22:06:14,656 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45315,1690063572016, state=OPEN 2023-07-22 22:06:14,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 22:06:14,659 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 22:06:14,659 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 22:06:14,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 22:06:14,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45315,1690063572016 in 506 msec 2023-07-22 22:06:14,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 22:06:14,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 740 msec 2023-07-22 22:06:14,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1560 sec 2023-07-22 22:06:14,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690063574687, completionTime=-1 2023-07-22 22:06:14,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-22 22:06:14,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 22:06:14,791 DEBUG [hconnection-0x8bde54f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:14,794 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:14,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-22 22:06:14,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690063634820 2023-07-22 22:06:14,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690063694820 2023-07-22 22:06:14,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 131 msec 2023-07-22 22:06:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1690063570541-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1690063570541-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1690063570541-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41269, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,860 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 22:06:14,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 22:06:14,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:14,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 22:06:14,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:14,903 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:14,933 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:14,936 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834 empty. 2023-07-22 22:06:14,936 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:14,936 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 22:06:15,020 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:15,022 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b0f065e22f9b07b7b4cb4ea7e45e1834, NAME => 'hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:15,042 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:15,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b0f065e22f9b07b7b4cb4ea7e45e1834, disabling compactions & flushes 2023-07-22 22:06:15,043 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. after waiting 0 ms 2023-07-22 22:06:15,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,043 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b0f065e22f9b07b7b4cb4ea7e45e1834: 2023-07-22 22:06:15,048 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:15,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690063575053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063575053"}]},"ts":"1690063575053"} 2023-07-22 22:06:15,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 22:06:15,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:15,109 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063575105"}]},"ts":"1690063575105"} 2023-07-22 22:06:15,113 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 22:06:15,118 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:15,119 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:15,119 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:15,119 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:15,119 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:15,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b0f065e22f9b07b7b4cb4ea7e45e1834, ASSIGN}] 2023-07-22 22:06:15,126 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b0f065e22f9b07b7b4cb4ea7e45e1834, ASSIGN 2023-07-22 22:06:15,128 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b0f065e22f9b07b7b4cb4ea7e45e1834, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:06:15,281 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 22:06:15,282 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b0f065e22f9b07b7b4cb4ea7e45e1834, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:15,282 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690063575281"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063575281"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063575281"}]},"ts":"1690063575281"} 2023-07-22 22:06:15,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b0f065e22f9b07b7b4cb4ea7e45e1834, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:15,452 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0f065e22f9b07b7b4cb4ea7e45e1834, NAME => 'hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:15,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. service=AccessControlService 2023-07-22 22:06:15,454 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:15,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:15,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,459 INFO [StoreOpener-b0f065e22f9b07b7b4cb4ea7e45e1834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,461 DEBUG [StoreOpener-b0f065e22f9b07b7b4cb4ea7e45e1834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/info 2023-07-22 22:06:15,461 DEBUG [StoreOpener-b0f065e22f9b07b7b4cb4ea7e45e1834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/info 2023-07-22 22:06:15,462 INFO [StoreOpener-b0f065e22f9b07b7b4cb4ea7e45e1834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0f065e22f9b07b7b4cb4ea7e45e1834 columnFamilyName info 2023-07-22 22:06:15,463 INFO [StoreOpener-b0f065e22f9b07b7b4cb4ea7e45e1834-1] regionserver.HStore(310): Store=b0f065e22f9b07b7b4cb4ea7e45e1834/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:15,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,467 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:06:15,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:15,478 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b0f065e22f9b07b7b4cb4ea7e45e1834; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63957638, jitterRate=-0.046956926584243774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:15,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b0f065e22f9b07b7b4cb4ea7e45e1834: 2023-07-22 22:06:15,480 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834., pid=6, masterSystemTime=1690063575443 2023-07-22 22:06:15,485 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,485 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:06:15,486 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b0f065e22f9b07b7b4cb4ea7e45e1834, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:15,487 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690063575486"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063575486"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063575486"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063575486"}]},"ts":"1690063575486"} 2023-07-22 22:06:15,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 22:06:15,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b0f065e22f9b07b7b4cb4ea7e45e1834, server=jenkins-hbase4.apache.org,45315,1690063572016 in 204 msec 2023-07-22 22:06:15,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 22:06:15,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b0f065e22f9b07b7b4cb4ea7e45e1834, ASSIGN in 374 msec 2023-07-22 22:06:15,503 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:15,503 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063575503"}]},"ts":"1690063575503"} 2023-07-22 22:06:15,506 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 22:06:15,510 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:15,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 633 msec 2023-07-22 22:06:15,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 22:06:15,601 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 22:06:15,601 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:15,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 22:06:15,663 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 22:06:15,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-07-22 22:06:15,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 22:06:15,686 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 22:06:15,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-22 22:06:15,699 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 22:06:15,702 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 22:06:15,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.451sec 2023-07-22 22:06:15,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-22 22:06:15,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 22:06:15,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 22:06:15,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1690063570541-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 22:06:15,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1690063570541-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 22:06:15,719 DEBUG [Listener at localhost/36705] zookeeper.ReadOnlyZKClient(139): Connect 0x4900eff1 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:15,723 DEBUG [Listener at localhost/36705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@785ad6ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:15,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:15,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 22:06:15,742 DEBUG [hconnection-0x65bc5bc3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:15,744 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:15,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:15,748 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:15,749 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312 empty. 2023-07-22 22:06:15,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-22 22:06:15,751 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:15,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 22:06:15,759 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:15,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:15,762 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:06:15,762 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/test.cache.data in system properties and HBase conf 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop.log.dir in system properties and HBase conf 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 22:06:15,763 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 22:06:15,764 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/nfs.dump.dir in system properties and HBase conf 2023-07-22 22:06:15,765 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir in system properties and HBase conf 2023-07-22 22:06:15,765 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:15,765 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 22:06:15,765 INFO [Listener at localhost/36705] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-22 22:06:15,791 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:15,800 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b59ff6cf2d83efc7ddc8899ef59e312, NAME => 'hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:15,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:15,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8b59ff6cf2d83efc7ddc8899ef59e312, disabling compactions & flushes 2023-07-22 22:06:15,832 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:15,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:15,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. after waiting 0 ms 2023-07-22 22:06:15,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:15,833 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:15,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8b59ff6cf2d83efc7ddc8899ef59e312: 2023-07-22 22:06:15,839 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:15,841 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690063575841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063575841"}]},"ts":"1690063575841"} 2023-07-22 22:06:15,844 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 22:06:15,848 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:15,849 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063575848"}]},"ts":"1690063575848"} 2023-07-22 22:06:15,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 22:06:15,859 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:15,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:15,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:15,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:15,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:15,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8b59ff6cf2d83efc7ddc8899ef59e312, ASSIGN}] 2023-07-22 22:06:15,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:15,867 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8b59ff6cf2d83efc7ddc8899ef59e312, ASSIGN 2023-07-22 22:06:15,869 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8b59ff6cf2d83efc7ddc8899ef59e312, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37263,1690063572153; forceNewPlan=false, retain=false 2023-07-22 22:06:16,019 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 22:06:16,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8b59ff6cf2d83efc7ddc8899ef59e312, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:16,021 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690063576020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063576020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063576020"}]},"ts":"1690063576020"} 2023-07-22 22:06:16,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8b59ff6cf2d83efc7ddc8899ef59e312, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:06:16,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:16,179 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:16,182 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:06:16,187 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:06:16,194 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:16,194 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b59ff6cf2d83efc7ddc8899ef59e312, NAME => 'hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:16,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. service=AccessControlService 2023-07-22 22:06:16,195 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:16,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:16,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,204 INFO [StoreOpener-8b59ff6cf2d83efc7ddc8899ef59e312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,207 DEBUG [StoreOpener-8b59ff6cf2d83efc7ddc8899ef59e312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/l 2023-07-22 22:06:16,207 DEBUG [StoreOpener-8b59ff6cf2d83efc7ddc8899ef59e312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/l 2023-07-22 22:06:16,208 INFO [StoreOpener-8b59ff6cf2d83efc7ddc8899ef59e312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b59ff6cf2d83efc7ddc8899ef59e312 columnFamilyName l 2023-07-22 22:06:16,209 INFO [StoreOpener-8b59ff6cf2d83efc7ddc8899ef59e312-1] regionserver.HStore(310): Store=8b59ff6cf2d83efc7ddc8899ef59e312/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:16,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:06:16,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:16,226 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b59ff6cf2d83efc7ddc8899ef59e312; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75464141, jitterRate=0.12450332939624786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:16,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b59ff6cf2d83efc7ddc8899ef59e312: 2023-07-22 22:06:16,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312., pid=11, masterSystemTime=1690063576179 2023-07-22 22:06:16,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:16,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:06:16,234 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8b59ff6cf2d83efc7ddc8899ef59e312, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:16,234 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690063576234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063576234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063576234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063576234"}]},"ts":"1690063576234"} 2023-07-22 22:06:16,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-22 22:06:16,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8b59ff6cf2d83efc7ddc8899ef59e312, server=jenkins-hbase4.apache.org,37263,1690063572153 in 213 msec 2023-07-22 22:06:16,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-22 22:06:16,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8b59ff6cf2d83efc7ddc8899ef59e312, ASSIGN in 378 msec 2023-07-22 22:06:16,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:16,247 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063576247"}]},"ts":"1690063576247"} 2023-07-22 22:06:16,249 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 22:06:16,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:16,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 515 msec 2023-07-22 22:06:16,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:16,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-22 22:06:16,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-22 22:06:17,182 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:17,499 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:17,505 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36705_jobhistory____.ycuee6/webapp 2023-07-22 22:06:17,673 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-22 22:06:17,673 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:17,673 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:17,676 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:17,754 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:18,057 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:18,320 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-22 22:06:18,353 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36705 2023-07-22 22:06:18,677 WARN [Listener at jenkins-hbase4.apache.org/33107] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:19,116 WARN [Listener at jenkins-hbase4.apache.org/33107] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 22:06:19,117 INFO [Listener at jenkins-hbase4.apache.org/33107] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:19,126 INFO [Listener at jenkins-hbase4.apache.org/33107] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35529_cluster____.3doily/webapp 2023-07-22 22:06:19,226 INFO [Listener at jenkins-hbase4.apache.org/33107] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:19,226 INFO [Listener at jenkins-hbase4.apache.org/33107] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-22 22:06:19,227 INFO [Listener at jenkins-hbase4.apache.org/33107] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:19,227 INFO [Listener at jenkins-hbase4.apache.org/33107] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:19,238 INFO [Listener at jenkins-hbase4.apache.org/33107] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:19,574 INFO [Listener at jenkins-hbase4.apache.org/33107] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:19,816 INFO [Listener at jenkins-hbase4.apache.org/33107] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:19,833 INFO [Listener at jenkins-hbase4.apache.org/33107] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35529 2023-07-22 22:06:20,269 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:06:20,425 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 22:06:20,427 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 22:06:20,428 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 22:06:20,638 WARN [Listener at jenkins-hbase4.apache.org/42767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:20,662 WARN [Listener at jenkins-hbase4.apache.org/42767] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 22:06:20,663 INFO [Listener at jenkins-hbase4.apache.org/42767] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:20,668 INFO [Listener at jenkins-hbase4.apache.org/42767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36093_node____gm24at/webapp 2023-07-22 22:06:20,727 INFO [Listener at jenkins-hbase4.apache.org/42767] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 22:06:20,727 INFO [Listener at jenkins-hbase4.apache.org/42767] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:20,727 INFO [Listener at jenkins-hbase4.apache.org/42767] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:20,727 INFO [Listener at jenkins-hbase4.apache.org/42767] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:20,735 INFO [Listener at jenkins-hbase4.apache.org/42767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,746 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:20,747 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 22:06:20,748 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:20,748 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 22:06:20,748 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 22:06:20,748 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 22:06:20,748 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:20,748 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 22:06:20,749 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 22:06:20,749 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 22:06:20,756 INFO [Listener at jenkins-hbase4.apache.org/42767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,851 INFO [Listener at jenkins-hbase4.apache.org/42767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,865 INFO [Listener at jenkins-hbase4.apache.org/42767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36093 2023-07-22 22:06:21,247 WARN [Listener at jenkins-hbase4.apache.org/46525] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:21,253 WARN [Listener at jenkins-hbase4.apache.org/46525] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 22:06:21,254 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:21,272 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42345_node____cldwc4/webapp 2023-07-22 22:06:21,346 INFO [Listener at jenkins-hbase4.apache.org/46525] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 22:06:21,346 INFO [Listener at jenkins-hbase4.apache.org/46525] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:21,346 INFO [Listener at jenkins-hbase4.apache.org/46525] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:21,346 INFO [Listener at jenkins-hbase4.apache.org/46525] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:21,356 INFO [Listener at jenkins-hbase4.apache.org/46525] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,372 INFO [Listener at jenkins-hbase4.apache.org/46525] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,453 INFO [Listener at jenkins-hbase4.apache.org/46525] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,463 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42345 2023-07-22 22:06:21,507 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-22 22:06:21,509 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:21,589 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=173, AvailableMemoryMB=8376 2023-07-22 22:06:21,589 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-22 22:06:21,607 DEBUG [Listener at jenkins-hbase4.apache.org/46525] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 22:06:21,615 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 22:06:21,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 22:06:21,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:21,631 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:21,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-22 22:06:21,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:21,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:21,642 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:21,643 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:21,645 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 empty. 2023-07-22 22:06:21,647 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b empty. 2023-07-22 22:06:21,648 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:21,658 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:21,659 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 22:06:21,691 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:21,696 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 49252114b8fa6615adfce19e9875334b, NAME => 'testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:21,696 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ced8cfc8487eaac62a43be13a9f719b8, NAME => 'testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:21,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:21,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 49252114b8fa6615adfce19e9875334b, disabling compactions & flushes 2023-07-22 22:06:21,734 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:21,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:21,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. after waiting 0 ms 2023-07-22 22:06:21,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:21,734 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:21,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 49252114b8fa6615adfce19e9875334b: 2023-07-22 22:06:21,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:21,737 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ced8cfc8487eaac62a43be13a9f719b8, disabling compactions & flushes 2023-07-22 22:06:21,737 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:21,737 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:21,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. after waiting 1 ms 2023-07-22 22:06:21,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:21,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:21,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ced8cfc8487eaac62a43be13a9f719b8: 2023-07-22 22:06:21,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:21,742 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:21,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063581743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063581743"}]},"ts":"1690063581743"} 2023-07-22 22:06:21,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063581743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063581743"}]},"ts":"1690063581743"} 2023-07-22 22:06:21,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:06:21,798 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:21,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063581798"}]},"ts":"1690063581798"} 2023-07-22 22:06:21,801 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-22 22:06:21,807 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:21,809 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:21,809 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:21,809 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:21,809 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:21,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, ASSIGN}] 2023-07-22 22:06:21,814 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, ASSIGN 2023-07-22 22:06:21,814 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, ASSIGN 2023-07-22 22:06:21,815 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:06:21,815 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33875,1690063572086; forceNewPlan=false, retain=false 2023-07-22 22:06:21,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:21,965 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:06:21,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ced8cfc8487eaac62a43be13a9f719b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:21,968 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=49252114b8fa6615adfce19e9875334b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:21,968 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063581968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063581968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063581968"}]},"ts":"1690063581968"} 2023-07-22 22:06:21,968 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063581968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063581968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063581968"}]},"ts":"1690063581968"} 2023-07-22 22:06:21,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure ced8cfc8487eaac62a43be13a9f719b8, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:06:21,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 49252114b8fa6615adfce19e9875334b, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:22,127 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:22,127 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:06:22,131 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:06:22,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:22,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 49252114b8fa6615adfce19e9875334b, NAME => 'testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:06:22,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. service=AccessControlService 2023-07-22 22:06:22,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:22,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ced8cfc8487eaac62a43be13a9f719b8, NAME => 'testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. service=AccessControlService 2023-07-22 22:06:22,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:22,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,144 INFO [StoreOpener-49252114b8fa6615adfce19e9875334b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,144 INFO [StoreOpener-ced8cfc8487eaac62a43be13a9f719b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,146 DEBUG [StoreOpener-49252114b8fa6615adfce19e9875334b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf 2023-07-22 22:06:22,146 DEBUG [StoreOpener-49252114b8fa6615adfce19e9875334b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf 2023-07-22 22:06:22,146 DEBUG [StoreOpener-ced8cfc8487eaac62a43be13a9f719b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf 2023-07-22 22:06:22,146 DEBUG [StoreOpener-ced8cfc8487eaac62a43be13a9f719b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf 2023-07-22 22:06:22,150 INFO [StoreOpener-49252114b8fa6615adfce19e9875334b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49252114b8fa6615adfce19e9875334b columnFamilyName cf 2023-07-22 22:06:22,150 INFO [StoreOpener-ced8cfc8487eaac62a43be13a9f719b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ced8cfc8487eaac62a43be13a9f719b8 columnFamilyName cf 2023-07-22 22:06:22,152 INFO [StoreOpener-49252114b8fa6615adfce19e9875334b-1] regionserver.HStore(310): Store=49252114b8fa6615adfce19e9875334b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:22,152 INFO [StoreOpener-ced8cfc8487eaac62a43be13a9f719b8-1] regionserver.HStore(310): Store=ced8cfc8487eaac62a43be13a9f719b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:22,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:22,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:22,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:22,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 49252114b8fa6615adfce19e9875334b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67706097, jitterRate=0.008899465203285217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 49252114b8fa6615adfce19e9875334b: 2023-07-22 22:06:22,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ced8cfc8487eaac62a43be13a9f719b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61229781, jitterRate=-0.08760516345500946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:22,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ced8cfc8487eaac62a43be13a9f719b8: 2023-07-22 22:06:22,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b., pid=16, masterSystemTime=1690063582127 2023-07-22 22:06:22,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8., pid=15, masterSystemTime=1690063582127 2023-07-22 22:06:22,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:22,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:22,177 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=49252114b8fa6615adfce19e9875334b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:22,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:22,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:22,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063582177"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063582177"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063582177"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063582177"}]},"ts":"1690063582177"} 2023-07-22 22:06:22,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ced8cfc8487eaac62a43be13a9f719b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:22,179 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063582179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063582179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063582179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063582179"}]},"ts":"1690063582179"} 2023-07-22 22:06:22,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-22 22:06:22,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 49252114b8fa6615adfce19e9875334b, server=jenkins-hbase4.apache.org,45315,1690063572016 in 207 msec 2023-07-22 22:06:22,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-22 22:06:22,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure ced8cfc8487eaac62a43be13a9f719b8, server=jenkins-hbase4.apache.org,33875,1690063572086 in 211 msec 2023-07-22 22:06:22,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, ASSIGN in 376 msec 2023-07-22 22:06:22,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-22 22:06:22,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, ASSIGN in 378 msec 2023-07-22 22:06:22,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:22,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063582192"}]},"ts":"1690063582192"} 2023-07-22 22:06:22,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-22 22:06:22,196 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:22,201 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-22 22:06:22,206 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,209 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,212 DEBUG [hconnection-0x45830608-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,214 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,224 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 22:06:22,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:22,264 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,264 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,264 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:22,264 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,264 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 657 msec 2023-07-22 22:06:22,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:22,746 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-22 22:06:22,751 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 22:06:22,752 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:22,755 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:22,783 DEBUG [hconnection-0x65bc5bc3-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,788 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:22,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063582807 (current time:1690063582807). 2023-07-22 22:06:22,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:22,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x3b4cd0b4 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:22,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7909e6a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,821 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b4cd0b4 to 127.0.0.1:62392 2023-07-22 22:06:22,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:22,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x3ee0cb57 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:22,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5aa6336c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:22,838 DEBUG [hconnection-0x5c2000a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,839 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,844 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ee0cb57 to 127.0.0.1:62392 2023-07-22 22:06:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 22:06:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:22,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:22,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:22,896 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:22,897 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690064182897 2023-07-22 22:06:22,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:22,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 22:06:22,904 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:22,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:22,906 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:22,907 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:22,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-22 22:06:22,908 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:22,911 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690064182911 2023-07-22 22:06:22,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,969 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-22 22:06:22,969 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:22,971 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 22:06:22,971 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 22:06:22,971 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,972 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,975 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:22,975 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:22,975 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:22,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:22,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:22,975 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:22,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,977 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,977 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:22,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,977 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:22,978 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 22:06:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 22:06:22,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 22:06:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:22,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,985 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:22,987 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:22,990 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:22,996 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:22,996 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,996 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:22,996 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:22,996 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:22,997 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,997 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:22,997 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:22,997 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:22,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:22,998 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:22,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,007 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,013 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:23,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b8828e0[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:23,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b8828e0[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:23,021 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 22:06:23,021 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,025 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,026 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,026 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,026 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,027 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,027 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:23,027 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:06:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,030 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,030 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. started... 2023-07-22 22:06:23,031 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,035 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,035 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:23,036 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. started... 2023-07-22 22:06:23,036 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,036 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,036 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,042 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 49252114b8fa6615adfce19e9875334b: 2023-07-22 22:06:23,043 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ced8cfc8487eaac62a43be13a9f719b8: 2023-07-22 22:06:23,044 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,044 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,052 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:23,052 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:23,058 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:23,058 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:23,110 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. completed. 2023-07-22 22:06:23,110 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:23,110 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. completed. 2023-07-22 22:06:23,110 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:23,110 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:23,110 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:06:23,110 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:06:23,114 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,114 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,114 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,114 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,115 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,115 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,115 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,115 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:06:23,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 22:06:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:06:23,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 22:06:23,129 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-22 22:06:23,129 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:23,129 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:23,129 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,129 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:23,133 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,134 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,134 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,135 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,136 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,137 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,139 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,140 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,140 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,155 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,155 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,156 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-22 22:06:23,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,158 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,156 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 22:06:23,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,213 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,216 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:23,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 22:06:23,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,323 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690063582901Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690063583198 (+297 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690063583199 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690063583199Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690063583224 (+25 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690063583258 (+34 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690063583322 (+64 ms) 2023-07-22 22:06:23,325 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 421 msec 2023-07-22 22:06:23,516 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:23,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33875] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:23,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45315] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:23,543 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 22:06:23,544 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:23,544 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:23,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063583560 (current time:1690063583560). 2023-07-22 22:06:23,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:23,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x28df919f to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:23,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fbfa5fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:23,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,575 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28df919f to 127.0.0.1:62392 2023-07-22 22:06:23,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:23,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x13b52484 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:23,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47321c04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:23,586 DEBUG [hconnection-0x6580d952-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,588 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,595 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13b52484 to 127.0.0.1:62392 2023-07-22 22:06:23,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:23,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 22:06:23,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:23,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,601 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,602 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690064183602 2023-07-22 22:06:23,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 22:06:23,603 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:23,603 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:23,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,605 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-22 22:06:23,607 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,608 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690064183608 2023-07-22 22:06:23,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-22 22:06:23,623 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-22 22:06:23,623 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,624 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 22:06:23,624 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 22:06:23,624 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,624 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,626 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,626 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,626 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,626 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,627 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,627 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,628 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,628 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,628 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,628 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 22:06:23,629 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,629 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,629 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,630 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,630 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,630 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,630 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,630 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,631 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,631 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,632 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,632 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,632 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,634 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,634 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,634 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,634 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,634 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,634 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,634 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,635 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,635 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,635 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,635 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fce2f13[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:23,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fce2f13[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:23,642 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 22:06:23,642 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,649 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,649 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,649 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. started... 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,649 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:23,650 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ced8cfc8487eaac62a43be13a9f719b8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-22 22:06:23,650 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. started... 2023-07-22 22:06:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:06:23,650 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,650 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:23,650 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 49252114b8fa6615adfce19e9875334b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-22 22:06:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,704 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,706 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:23,854 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722ea2a3bd69bce4791bf165ba393e44ca2 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722ea2a3bd69bce4791bf165ba393e44ca2 2023-07-22 22:06:23,854 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722cac90d7b84c24071a8bc5ca724572018 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722cac90d7b84c24071a8bc5ca724572018 2023-07-22 22:06:23,891 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/.tmp/cf/ed382327996b443d9f7fc6fab6598e7d 2023-07-22 22:06:23,892 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/.tmp/cf/f1c3d0d01d074656beaa89a81712f29f 2023-07-22 22:06:23,906 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,907 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/.tmp/cf/f1c3d0d01d074656beaa89a81712f29f as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf/f1c3d0d01d074656beaa89a81712f29f 2023-07-22 22:06:23,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,908 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:23,917 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf/f1c3d0d01d074656beaa89a81712f29f, entries=4, sequenceid=6, filesize=5.6 K 2023-07-22 22:06:23,925 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for ced8cfc8487eaac62a43be13a9f719b8 in 275ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:23,925 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/.tmp/cf/ed382327996b443d9f7fc6fab6598e7d as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf/ed382327996b443d9f7fc6fab6598e7d 2023-07-22 22:06:23,925 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 22:06:23,926 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ced8cfc8487eaac62a43be13a9f719b8: 2023-07-22 22:06:23,927 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:23,927 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:23,927 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf/f1c3d0d01d074656beaa89a81712f29f] hfiles 2023-07-22 22:06:23,927 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf/f1c3d0d01d074656beaa89a81712f29f for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:23,938 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf/ed382327996b443d9f7fc6fab6598e7d, entries=46, sequenceid=6, filesize=12.6 K 2023-07-22 22:06:23,941 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 49252114b8fa6615adfce19e9875334b in 291ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:23,942 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 49252114b8fa6615adfce19e9875334b: 2023-07-22 22:06:23,943 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:23,943 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:23,943 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf/ed382327996b443d9f7fc6fab6598e7d] hfiles 2023-07-22 22:06:23,943 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf/ed382327996b443d9f7fc6fab6598e7d for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:23,961 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. completed. 2023-07-22 22:06:23,962 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:06:23,965 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. completed. 2023-07-22 22:06:23,965 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,965 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:06:23,967 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,967 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,967 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,967 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,968 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,968 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,968 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,968 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:06:23,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 22:06:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:06:23,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 22:06:23,980 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-22 22:06:23,980 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:23,980 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:23,980 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,980 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,983 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,985 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,986 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,989 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:23,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,989 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:23,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:23,990 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:24,003 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:24,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,004 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:24,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:24,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:24,005 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,005 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,004 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-22 22:06:24,004 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:24,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-22 22:06:24,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:24,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:24,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:24,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:06:24,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,006 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,006 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:24,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,006 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,007 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:24,007 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:24,007 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,007 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722cac90d7b84c24071a8bc5ca724572018, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722ea2a3bd69bce4791bf165ba393e44ca2] mob files 2023-07-22 22:06:24,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722cac90d7b84c24071a8bc5ca724572018 2023-07-22 22:06:24,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722ea2a3bd69bce4791bf165ba393e44ca2 2023-07-22 22:06:24,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-22 22:06:24,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 22:06:24,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,126 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690063583602Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690063584037 (+435 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690063584037Loading Region manifests for snaptb0-testExportWithTargetName at 1690063584037Writing data manifest for snaptb0-testExportWithTargetName at 1690063584049 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690063584069 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690063584125 (+56 ms) 2023-07-22 22:06:24,128 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:24,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 526 msec 2023-07-22 22:06:24,222 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:24,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:24,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:24,226 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226 2023-07-22 22:06:24,226 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35247, tgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226, rawTgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:24,267 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:24,267 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1458856473_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 22:06:24,267 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-22 22:06:24,287 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 22:06:24,380 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,381 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,381 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,381 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,382 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,382 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,382 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,456 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-3831290657848297926.jar 2023-07-22 22:06:24,457 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,457 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,458 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,458 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,459 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,459 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:24,459 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:06:24,460 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:06:24,460 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:06:24,461 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:06:24,461 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:06:24,462 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:06:24,462 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:06:24,463 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:06:24,463 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:06:24,464 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:06:24,467 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:24,467 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:24,467 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:24,468 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:24,468 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:24,468 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:24,469 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:26,012 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:06:26,019 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-22 22:06:26,031 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-22 22:06:26,958 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:26,960 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:27,223 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:27,656 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:06:32,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:34,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:38,851 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:40,379 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:06:40,381 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:06:40,391 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-22 22:06:40,392 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:06:40,392 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:06:40,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 22:06:40,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-22 22:06:40,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-22 22:06:40,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226/.hbase-snapshot/testExportWithTargetName 2023-07-22 22:06:40,394 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-22 22:06:40,394 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063584226/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-22 22:06:40,407 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-22 22:06:40,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-22 22:06:40,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,438 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063600438"}]},"ts":"1690063600438"} 2023-07-22 22:06:40,442 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-22 22:06:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 22:06:40,446 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-22 22:06:40,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, UNASSIGN}] 2023-07-22 22:06:40,452 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, UNASSIGN 2023-07-22 22:06:40,454 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, UNASSIGN 2023-07-22 22:06:40,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=49252114b8fa6615adfce19e9875334b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:40,457 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ced8cfc8487eaac62a43be13a9f719b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:40,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063600457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063600457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063600457"}]},"ts":"1690063600457"} 2023-07-22 22:06:40,457 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063600457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063600457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063600457"}]},"ts":"1690063600457"} 2023-07-22 22:06:40,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 49252114b8fa6615adfce19e9875334b, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:40,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure ced8cfc8487eaac62a43be13a9f719b8, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:06:40,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 22:06:40,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:40,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ced8cfc8487eaac62a43be13a9f719b8, disabling compactions & flushes 2023-07-22 22:06:40,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:40,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:40,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:40,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 49252114b8fa6615adfce19e9875334b, disabling compactions & flushes 2023-07-22 22:06:40,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. after waiting 0 ms 2023-07-22 22:06:40,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:40,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:40,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:40,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. after waiting 0 ms 2023-07-22 22:06:40,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:40,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:40,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:40,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:40,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8. 2023-07-22 22:06:40,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ced8cfc8487eaac62a43be13a9f719b8: 2023-07-22 22:06:40,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:40,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b. 2023-07-22 22:06:40,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 49252114b8fa6615adfce19e9875334b: 2023-07-22 22:06:40,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:40,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=49252114b8fa6615adfce19e9875334b, regionState=CLOSED 2023-07-22 22:06:40,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:40,653 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063600653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063600653"}]},"ts":"1690063600653"} 2023-07-22 22:06:40,654 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ced8cfc8487eaac62a43be13a9f719b8, regionState=CLOSED 2023-07-22 22:06:40,654 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063600654"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063600654"}]},"ts":"1690063600654"} 2023-07-22 22:06:40,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-22 22:06:40,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 49252114b8fa6615adfce19e9875334b, server=jenkins-hbase4.apache.org,45315,1690063572016 in 196 msec 2023-07-22 22:06:40,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-22 22:06:40,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure ced8cfc8487eaac62a43be13a9f719b8, server=jenkins-hbase4.apache.org,33875,1690063572086 in 197 msec 2023-07-22 22:06:40,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=49252114b8fa6615adfce19e9875334b, UNASSIGN in 208 msec 2023-07-22 22:06:40,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-22 22:06:40,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ced8cfc8487eaac62a43be13a9f719b8, UNASSIGN in 210 msec 2023-07-22 22:06:40,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063600666"}]},"ts":"1690063600666"} 2023-07-22 22:06:40,668 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-22 22:06:40,669 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-22 22:06:40,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 255 msec 2023-07-22 22:06:40,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 22:06:40,745 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-22 22:06:40,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-22 22:06:40,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,760 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-22 22:06:40,762 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,765 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-22 22:06:40,768 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:40,768 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:40,769 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:40,769 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:40,769 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:40,769 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:40,771 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,771 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 22:06:40,771 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:06:40,771 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 22:06:40,771 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:06:40,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 22:06:40,771 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:06:40,772 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 22:06:40,772 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:06:40,772 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/recovered.edits] 2023-07-22 22:06:40,774 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/recovered.edits] 2023-07-22 22:06:40,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 22:06:40,781 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf/f1c3d0d01d074656beaa89a81712f29f to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/cf/f1c3d0d01d074656beaa89a81712f29f 2023-07-22 22:06:40,781 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf/ed382327996b443d9f7fc6fab6598e7d to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/cf/ed382327996b443d9f7fc6fab6598e7d 2023-07-22 22:06:40,786 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8/recovered.edits/9.seqid 2023-07-22 22:06:40,786 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b/recovered.edits/9.seqid 2023-07-22 22:06:40,786 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/ced8cfc8487eaac62a43be13a9f719b8 2023-07-22 22:06:40,786 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportWithTargetName/49252114b8fa6615adfce19e9875334b 2023-07-22 22:06:40,786 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 22:06:40,787 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-22 22:06:40,788 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-22 22:06:40,791 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722cac90d7b84c24071a8bc5ca724572018 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722cac90d7b84c24071a8bc5ca724572018 2023-07-22 22:06:40,793 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722ea2a3bd69bce4791bf165ba393e44ca2 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722ea2a3bd69bce4791bf165ba393e44ca2 2023-07-22 22:06:40,793 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-22 22:06:40,796 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,816 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-22 22:06:40,819 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-22 22:06:40,821 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,821 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-22 22:06:40,821 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063600821"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:40,821 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063600821"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:40,823 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:06:40,823 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ced8cfc8487eaac62a43be13a9f719b8, NAME => 'testtb-testExportWithTargetName,,1690063581623.ced8cfc8487eaac62a43be13a9f719b8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 49252114b8fa6615adfce19e9875334b, NAME => 'testtb-testExportWithTargetName,1,1690063581623.49252114b8fa6615adfce19e9875334b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:06:40,823 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-22 22:06:40,823 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063600823"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:40,825 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-22 22:06:40,828 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:40,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 76 msec 2023-07-22 22:06:40,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 22:06:40,879 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-22 22:06:40,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-22 22:06:40,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:40,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-22 22:06:40,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-22 22:06:40,934 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 707) Potentially hanging thread: Thread-1314 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2014211058_1 at /127.0.0.1:43668 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:45229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:46525 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:36050 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:45546 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:36015 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:54100 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=309 (was 272) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6550 (was 8376) 2023-07-22 22:06:40,935 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-22 22:06:40,955 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=179, AvailableMemoryMB=6550 2023-07-22 22:06:40,955 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-22 22:06:40,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 22:06:40,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:40,961 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:40,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-22 22:06:40,964 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:40,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:40,967 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:40,967 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:40,967 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 empty. 2023-07-22 22:06:40,968 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee empty. 2023-07-22 22:06:40,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:40,968 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:40,968 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 22:06:40,985 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:40,986 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 294a26e816575f6092d271e2837b42ee, NAME => 'testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:40,986 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 640d62fd83c8d146ad4e41162e08ac05, NAME => 'testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:41,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:41,009 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 294a26e816575f6092d271e2837b42ee, disabling compactions & flushes 2023-07-22 22:06:41,009 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,009 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,009 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. after waiting 0 ms 2023-07-22 22:06:41,009 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,009 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,009 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 294a26e816575f6092d271e2837b42ee: 2023-07-22 22:06:41,011 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:41,013 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 640d62fd83c8d146ad4e41162e08ac05, disabling compactions & flushes 2023-07-22 22:06:41,013 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,013 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,013 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. after waiting 0 ms 2023-07-22 22:06:41,013 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,013 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,013 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 640d62fd83c8d146ad4e41162e08ac05: 2023-07-22 22:06:41,016 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:41,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063601017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063601017"}]},"ts":"1690063601017"} 2023-07-22 22:06:41,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063601017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063601017"}]},"ts":"1690063601017"} 2023-07-22 22:06:41,020 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:06:41,021 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:41,021 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063601021"}]},"ts":"1690063601021"} 2023-07-22 22:06:41,023 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 22:06:41,027 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:41,029 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:41,029 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:41,029 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:41,029 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:41,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, ASSIGN}] 2023-07-22 22:06:41,032 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, ASSIGN 2023-07-22 22:06:41,032 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, ASSIGN 2023-07-22 22:06:41,033 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37263,1690063572153; forceNewPlan=false, retain=false 2023-07-22 22:06:41,033 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:06:41,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:41,183 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:06:41,186 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=294a26e816575f6092d271e2837b42ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,186 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=640d62fd83c8d146ad4e41162e08ac05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063601186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063601186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063601186"}]},"ts":"1690063601186"} 2023-07-22 22:06:41,187 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063601186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063601186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063601186"}]},"ts":"1690063601186"} 2023-07-22 22:06:41,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 294a26e816575f6092d271e2837b42ee, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:06:41,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 640d62fd83c8d146ad4e41162e08ac05, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:41,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:41,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 640d62fd83c8d146ad4e41162e08ac05, NAME => 'testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:06:41,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 294a26e816575f6092d271e2837b42ee, NAME => 'testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:06:41,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. service=AccessControlService 2023-07-22 22:06:41,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. service=AccessControlService 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,352 INFO [StoreOpener-640d62fd83c8d146ad4e41162e08ac05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,352 INFO [StoreOpener-294a26e816575f6092d271e2837b42ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,353 DEBUG [StoreOpener-294a26e816575f6092d271e2837b42ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf 2023-07-22 22:06:41,353 DEBUG [StoreOpener-640d62fd83c8d146ad4e41162e08ac05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf 2023-07-22 22:06:41,353 DEBUG [StoreOpener-294a26e816575f6092d271e2837b42ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf 2023-07-22 22:06:41,353 DEBUG [StoreOpener-640d62fd83c8d146ad4e41162e08ac05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf 2023-07-22 22:06:41,354 INFO [StoreOpener-294a26e816575f6092d271e2837b42ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 294a26e816575f6092d271e2837b42ee columnFamilyName cf 2023-07-22 22:06:41,354 INFO [StoreOpener-640d62fd83c8d146ad4e41162e08ac05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 640d62fd83c8d146ad4e41162e08ac05 columnFamilyName cf 2023-07-22 22:06:41,356 INFO [StoreOpener-640d62fd83c8d146ad4e41162e08ac05-1] regionserver.HStore(310): Store=640d62fd83c8d146ad4e41162e08ac05/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:41,356 INFO [StoreOpener-294a26e816575f6092d271e2837b42ee-1] regionserver.HStore(310): Store=294a26e816575f6092d271e2837b42ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:41,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:41,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:41,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:41,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:41,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 294a26e816575f6092d271e2837b42ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71030498, jitterRate=0.05843690037727356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:41,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 640d62fd83c8d146ad4e41162e08ac05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66978437, jitterRate=-0.0019435137510299683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:41,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 294a26e816575f6092d271e2837b42ee: 2023-07-22 22:06:41,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 640d62fd83c8d146ad4e41162e08ac05: 2023-07-22 22:06:41,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05., pid=31, masterSystemTime=1690063601343 2023-07-22 22:06:41,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee., pid=30, masterSystemTime=1690063601341 2023-07-22 22:06:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,368 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=294a26e816575f6092d271e2837b42ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,369 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063601368"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063601368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063601368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063601368"}]},"ts":"1690063601368"} 2023-07-22 22:06:41,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,372 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=640d62fd83c8d146ad4e41162e08ac05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,373 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063601372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063601372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063601372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063601372"}]},"ts":"1690063601372"} 2023-07-22 22:06:41,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-22 22:06:41,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 294a26e816575f6092d271e2837b42ee, server=jenkins-hbase4.apache.org,37263,1690063572153 in 185 msec 2023-07-22 22:06:41,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-22 22:06:41,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 640d62fd83c8d146ad4e41162e08ac05, server=jenkins-hbase4.apache.org,45315,1690063572016 in 186 msec 2023-07-22 22:06:41,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, ASSIGN in 348 msec 2023-07-22 22:06:41,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-22 22:06:41,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, ASSIGN in 351 msec 2023-07-22 22:06:41,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:41,384 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063601384"}]},"ts":"1690063601384"} 2023-07-22 22:06:41,386 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 22:06:41,388 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:41,388 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-22 22:06:41,390 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:06:41,391 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:41,391 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:41,391 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:41,391 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:41,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:41,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:41,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:41,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:41,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 435 msec 2023-07-22 22:06:41,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:41,568 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-22 22:06:41,572 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 22:06:41,572 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,575 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:41,592 DEBUG [hconnection-0x65bc5bc3-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,598 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:41,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063601606 (current time:1690063601606). 2023-07-22 22:06:41,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:41,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x59b65a4b to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:41,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ccc02a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,627 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b65a4b to 127.0.0.1:62392 2023-07-22 22:06:41,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:41,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x4cdff4e1 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:41,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27509b33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:41,744 DEBUG [hconnection-0x300ad263-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,750 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,757 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cdff4e1 to 127.0.0.1:62392 2023-07-22 22:06:41,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:41,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:06:41,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:41,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:41,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:41,764 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:41,765 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064201765 2023-07-22 22:06:41,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:41,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 22:06:41,767 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:41,767 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:41,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:41,768 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:41,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 22:06:41,773 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:41,774 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064201774 2023-07-22 22:06:41,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,801 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-22 22:06:41,801 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,802 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 22:06:41,803 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:06:41,803 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,803 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,806 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,806 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,806 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,806 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,806 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,806 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,807 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,807 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:41,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,813 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:41,813 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:41,813 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:41,813 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,813 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,822 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,826 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:41,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9e697b[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:41,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:41,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9e697b[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:41,832 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:06:41,832 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:41,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:41,834 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:41,834 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,834 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,834 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:41,834 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. started... 2023-07-22 22:06:41,840 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:41,840 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:41,840 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 294a26e816575f6092d271e2837b42ee: 2023-07-22 22:06:41,840 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,840 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:41,840 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. started... 2023-07-22 22:06:41,840 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,840 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,840 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:41,840 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:41,842 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:41,842 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 640d62fd83c8d146ad4e41162e08ac05: 2023-07-22 22:06:41,843 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,843 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:41,843 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:41,867 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:41,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:41,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:41,869 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:41,871 WARN [DataStreamer for file /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState/region-manifest.640d62fd83c8d146ad4e41162e08ac05] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-22 22:06:41,872 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. completed. 2023-07-22 22:06:41,872 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:06:41,874 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:41,874 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,874 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,883 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. completed. 2023-07-22 22:06:41,883 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:41,883 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:41,883 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:41,883 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,884 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:41,884 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:06:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:41,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,886 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:41,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:06:41,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:06:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:06:41,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:06:41,895 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-22 22:06:41,895 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:41,895 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:41,895 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,895 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,897 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,898 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,899 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,899 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,902 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,903 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,903 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,908 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,908 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,908 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,908 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,908 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,908 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-22 22:06:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,910 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:06:41,910 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,911 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 22:06:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:42,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 22:06:42,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:42,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:42,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690063601766Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690063601930 (+164 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690063601930Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690063601930Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690063601934 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690063601958 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690063602000 (+42 ms) 2023-07-22 22:06:42,003 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:42,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 237 msec 2023-07-22 22:06:42,070 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:42,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:42,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45315] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:42,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37263] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:42,089 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 22:06:42,089 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:42,090 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:42,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:42,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063602104 (current time:1690063602104). 2023-07-22 22:06:42,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:42,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x4a5595fb to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:42,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a04871, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:42,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:42,119 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:42,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a5595fb to 127.0.0.1:62392 2023-07-22 22:06:42,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:42,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x5fa33603 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:42,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1376aed7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:42,141 DEBUG [hconnection-0x593d50c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:42,142 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:42,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:42,149 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:42,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fa33603 to 127.0.0.1:62392 2023-07-22 22:06:42,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:42,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:06:42,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:42,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:42,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:42,155 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:42,156 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064202156 2023-07-22 22:06:42,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:42,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 22:06:42,158 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:42,158 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:42,159 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:42,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:42,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 22:06:42,162 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:42,163 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064202163 2023-07-22 22:06:42,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-22 22:06:42,183 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-22 22:06:42,184 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:42,185 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 22:06:42,185 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:06:42,186 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,186 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,187 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:42,187 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:42,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:42,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:42,187 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,187 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:42,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,188 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,188 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,189 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,189 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:42,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:42,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 22:06:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:42,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 22:06:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:42,191 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:42,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,191 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:42,191 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 22:06:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,192 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,194 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:42,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:42,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527fc52e[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:42,200 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:42,200 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:42,200 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:42,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 22:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:42,203 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,205 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,205 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,205 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:42,207 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:42,211 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,211 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:42,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:42,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527fc52e[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:42,211 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:06:42,211 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,212 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,212 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,212 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,213 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:42,213 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:42,213 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:06:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,213 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:42,213 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:42,213 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:42,214 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,214 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:42,214 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:42,214 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. started... 2023-07-22 22:06:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:42,214 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:42,214 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 294a26e816575f6092d271e2837b42ee 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-22 22:06:42,214 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. started... 2023-07-22 22:06:42,214 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 640d62fd83c8d146ad4e41162e08ac05 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-22 22:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:42,245 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722b911035fd9ef4622b7598cc92dabc855 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230722b911035fd9ef4622b7598cc92dabc855 2023-07-22 22:06:42,248 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072208af20a35dcf4528a3e959c9ccdb0dd9 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072208af20a35dcf4528a3e959c9ccdb0dd9 2023-07-22 22:06:42,258 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:42,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:42,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:42,260 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:42,270 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/.tmp/cf/96ab68afbc75451197a8046bfc61a2c0 2023-07-22 22:06:42,270 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/.tmp/cf/c07abf648c084fa98a30fd1a4e9c7db3 2023-07-22 22:06:42,278 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/.tmp/cf/c07abf648c084fa98a30fd1a4e9c7db3 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf/c07abf648c084fa98a30fd1a4e9c7db3 2023-07-22 22:06:42,281 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/.tmp/cf/96ab68afbc75451197a8046bfc61a2c0 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf/96ab68afbc75451197a8046bfc61a2c0 2023-07-22 22:06:42,286 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf/c07abf648c084fa98a30fd1a4e9c7db3, entries=7, sequenceid=6, filesize=6.1 K 2023-07-22 22:06:42,287 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 640d62fd83c8d146ad4e41162e08ac05 in 73ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:42,287 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-22 22:06:42,288 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 640d62fd83c8d146ad4e41162e08ac05: 2023-07-22 22:06:42,288 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:42,288 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:42,288 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf/c07abf648c084fa98a30fd1a4e9c7db3] hfiles 2023-07-22 22:06:42,288 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf/c07abf648c084fa98a30fd1a4e9c7db3 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:42,289 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf/96ab68afbc75451197a8046bfc61a2c0, entries=43, sequenceid=6, filesize=12.2 K 2023-07-22 22:06:42,295 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 294a26e816575f6092d271e2837b42ee in 81ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:42,300 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 294a26e816575f6092d271e2837b42ee: 2023-07-22 22:06:42,300 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:42,301 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:42,301 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf/96ab68afbc75451197a8046bfc61a2c0] hfiles 2023-07-22 22:06:42,301 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf/96ab68afbc75451197a8046bfc61a2c0 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:42,321 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. completed. 2023-07-22 22:06:42,321 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:42,321 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:42,321 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:42,321 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,321 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:42,321 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:06:42,330 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. completed. 2023-07-22 22:06:42,330 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:06:42,331 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:42,331 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:42,331 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:42,333 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:42,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:42,334 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:06:42,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:06:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:42,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:42,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:42,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:42,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:06:42,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:06:42,345 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-22 22:06:42,345 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:42,345 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:42,345 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-22 22:06:42,345 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:42,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:42,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:42,348 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:42,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:42,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:42,348 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:42,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:42,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,349 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,350 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,352 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:42,352 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:42,352 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,356 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:42,356 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:42,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:42,356 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:42,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-22 22:06:42,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:42,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:42,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:42,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:42,359 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,359 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:42,359 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:42,359 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,359 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:42,359 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:42,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:42,358 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:42,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:42,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:42,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072208af20a35dcf4528a3e959c9ccdb0dd9, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230722b911035fd9ef4622b7598cc92dabc855] mob files 2023-07-22 22:06:42,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072208af20a35dcf4528a3e959c9ccdb0dd9 2023-07-22 22:06:42,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230722b911035fd9ef4622b7598cc92dabc855 2023-07-22 22:06:42,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:42,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:42,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-22 22:06:42,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,454 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 22:06:42,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,455 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690063602157Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690063602385 (+228 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690063602385Loading Region manifests for snaptb0-testExportFileSystemState at 1690063602385Writing data manifest for snaptb0-testExportFileSystemState at 1690063602392 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690063602406 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690063602454 (+48 ms) 2023-07-22 22:06:42,459 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:42,462 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:42,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:42,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:42,464 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464 2023-07-22 22:06:42,464 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35247, tgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464, rawTgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:42,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 301 msec 2023-07-22 22:06:42,502 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:42,503 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1902834184_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,503 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-22 22:06:42,519 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,564 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,564 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,565 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,565 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,566 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,566 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,567 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,649 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-1325707902836070190.jar 2023-07-22 22:06:42,650 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,651 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,651 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,652 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,652 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,652 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,653 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:06:42,654 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:06:42,654 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:06:42,655 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:06:42,655 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:06:42,655 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:06:42,656 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:06:42,656 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:06:42,656 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:06:42,657 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:06:42,658 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,658 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,659 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:42,659 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,660 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,660 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:42,661 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:43,242 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:06:43,245 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-22 22:06:43,247 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(671): export split=0 size=31.0 K 2023-07-22 22:06:45,058 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:45,059 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:45,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:45,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:46,236 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:06:50,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:52,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:55,756 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:56,845 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:06:56,846 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:06:56,855 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-22 22:06:56,855 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:06:56,856 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:06:56,856 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 22:06:56,856 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 22:06:56,856 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 22:06:56,856 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 22:06:56,857 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 22:06:56,857 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063602464/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 22:06:56,864 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-22 22:06:56,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-22 22:06:56,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 22:06:56,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063616871"}]},"ts":"1690063616871"} 2023-07-22 22:06:56,872 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 22:06:56,875 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-22 22:06:56,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, UNASSIGN}] 2023-07-22 22:06:56,879 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, UNASSIGN 2023-07-22 22:06:56,879 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, UNASSIGN 2023-07-22 22:06:56,879 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=294a26e816575f6092d271e2837b42ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:56,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=640d62fd83c8d146ad4e41162e08ac05, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:56,880 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063616879"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063616879"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063616879"}]},"ts":"1690063616879"} 2023-07-22 22:06:56,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063616880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063616880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063616880"}]},"ts":"1690063616880"} 2023-07-22 22:06:56,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 640d62fd83c8d146ad4e41162e08ac05, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:56,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 294a26e816575f6092d271e2837b42ee, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:06:56,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 22:06:57,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:57,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 640d62fd83c8d146ad4e41162e08ac05, disabling compactions & flushes 2023-07-22 22:06:57,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:57,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:57,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. after waiting 0 ms 2023-07-22 22:06:57,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:57,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:57,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 294a26e816575f6092d271e2837b42ee, disabling compactions & flushes 2023-07-22 22:06:57,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:57,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:57,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. after waiting 0 ms 2023-07-22 22:06:57,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:57,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:57,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:57,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:57,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:57,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee. 2023-07-22 22:06:57,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05. 2023-07-22 22:06:57,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 294a26e816575f6092d271e2837b42ee: 2023-07-22 22:06:57,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 640d62fd83c8d146ad4e41162e08ac05: 2023-07-22 22:06:57,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:57,059 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=640d62fd83c8d146ad4e41162e08ac05, regionState=CLOSED 2023-07-22 22:06:57,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063617059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063617059"}]},"ts":"1690063617059"} 2023-07-22 22:06:57,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:57,060 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=294a26e816575f6092d271e2837b42ee, regionState=CLOSED 2023-07-22 22:06:57,060 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063617060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063617060"}]},"ts":"1690063617060"} 2023-07-22 22:06:57,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-22 22:06:57,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 640d62fd83c8d146ad4e41162e08ac05, server=jenkins-hbase4.apache.org,45315,1690063572016 in 180 msec 2023-07-22 22:06:57,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-22 22:06:57,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 294a26e816575f6092d271e2837b42ee, server=jenkins-hbase4.apache.org,37263,1690063572153 in 180 msec 2023-07-22 22:06:57,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640d62fd83c8d146ad4e41162e08ac05, UNASSIGN in 188 msec 2023-07-22 22:06:57,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-22 22:06:57,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=294a26e816575f6092d271e2837b42ee, UNASSIGN in 189 msec 2023-07-22 22:06:57,068 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063617068"}]},"ts":"1690063617068"} 2023-07-22 22:06:57,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 22:06:57,071 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-22 22:06:57,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 207 msec 2023-07-22 22:06:57,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 22:06:57,173 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-22 22:06:57,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-22 22:06:57,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:57,177 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:57,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-22 22:06:57,178 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:57,179 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-22 22:06:57,183 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,183 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,183 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,183 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,183 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:57,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:57,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:57,184 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:57,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:57,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:57,185 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/recovered.edits] 2023-07-22 22:06:57,186 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/recovered.edits] 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,186 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:57,187 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 22:06:57,190 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf/c07abf648c084fa98a30fd1a4e9c7db3 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/cf/c07abf648c084fa98a30fd1a4e9c7db3 2023-07-22 22:06:57,190 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf/96ab68afbc75451197a8046bfc61a2c0 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/cf/96ab68afbc75451197a8046bfc61a2c0 2023-07-22 22:06:57,193 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05/recovered.edits/9.seqid 2023-07-22 22:06:57,193 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee/recovered.edits/9.seqid 2023-07-22 22:06:57,194 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/640d62fd83c8d146ad4e41162e08ac05 2023-07-22 22:06:57,194 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemState/294a26e816575f6092d271e2837b42ee 2023-07-22 22:06:57,194 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 22:06:57,195 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-22 22:06:57,195 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-22 22:06:57,199 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072208af20a35dcf4528a3e959c9ccdb0dd9 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072208af20a35dcf4528a3e959c9ccdb0dd9 2023-07-22 22:06:57,200 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230722b911035fd9ef4622b7598cc92dabc855 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230722b911035fd9ef4622b7598cc92dabc855 2023-07-22 22:06:57,200 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-22 22:06:57,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:57,205 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-22 22:06:57,207 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-22 22:06:57,208 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:57,208 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-22 22:06:57,208 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063617208"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:57,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063617208"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:57,211 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:06:57,211 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 640d62fd83c8d146ad4e41162e08ac05, NAME => 'testtb-testExportFileSystemState,,1690063600956.640d62fd83c8d146ad4e41162e08ac05.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 294a26e816575f6092d271e2837b42ee, NAME => 'testtb-testExportFileSystemState,1,1690063600956.294a26e816575f6092d271e2837b42ee.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:06:57,211 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-22 22:06:57,211 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063617211"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:57,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-22 22:06:57,214 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:57,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 40 msec 2023-07-22 22:06:57,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 22:06:57,289 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-22 22:06:57,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-22 22:06:57,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:57,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-22 22:06:57,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-22 22:06:57,328 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 756) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:33881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_343032650_1 at /127.0.0.1:39992 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_343032650_1 at /127.0.0.1:59088 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:59102 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:56866 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:40014 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2146 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 309) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 179), AvailableMemoryMB=6451 (was 6550) 2023-07-22 22:06:57,328 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-22 22:06:57,347 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=178, AvailableMemoryMB=6450 2023-07-22 22:06:57,348 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-22 22:06:57,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 22:06:57,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:06:57,352 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:57,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-22 22:06:57,353 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:57,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,356 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,356 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,356 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 empty. 2023-07-22 22:06:57,356 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 empty. 2023-07-22 22:06:57,357 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,357 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,357 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 22:06:57,367 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:57,368 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a57e9da2a1876ca0c5128b272a178db9, NAME => 'testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:57,369 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 691411ea4291b6b33044a5fc8a19b4e8, NAME => 'testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a57e9da2a1876ca0c5128b272a178db9, disabling compactions & flushes 2023-07-22 22:06:57,378 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 691411ea4291b6b33044a5fc8a19b4e8, disabling compactions & flushes 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. after waiting 0 ms 2023-07-22 22:06:57,378 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,378 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,378 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. after waiting 0 ms 2023-07-22 22:06:57,379 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a57e9da2a1876ca0c5128b272a178db9: 2023-07-22 22:06:57,379 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,379 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,379 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 691411ea4291b6b33044a5fc8a19b4e8: 2023-07-22 22:06:57,381 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:57,382 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063617382"}]},"ts":"1690063617382"} 2023-07-22 22:06:57,382 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063617382"}]},"ts":"1690063617382"} 2023-07-22 22:06:57,385 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:06:57,386 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:57,386 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063617386"}]},"ts":"1690063617386"} 2023-07-22 22:06:57,388 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-22 22:06:57,391 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:57,393 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:57,393 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:57,393 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:57,393 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:57,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, ASSIGN}] 2023-07-22 22:06:57,396 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, ASSIGN 2023-07-22 22:06:57,396 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, ASSIGN 2023-07-22 22:06:57,397 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37263,1690063572153; forceNewPlan=false, retain=false 2023-07-22 22:06:57,397 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:06:57,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,547 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:06:57,550 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=691411ea4291b6b33044a5fc8a19b4e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:57,550 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a57e9da2a1876ca0c5128b272a178db9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:57,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063617550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063617550"}]},"ts":"1690063617550"} 2023-07-22 22:06:57,550 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063617550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063617550"}]},"ts":"1690063617550"} 2023-07-22 22:06:57,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 691411ea4291b6b33044a5fc8a19b4e8, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:06:57,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a57e9da2a1876ca0c5128b272a178db9, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:06:57,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a57e9da2a1876ca0c5128b272a178db9, NAME => 'testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 691411ea4291b6b33044a5fc8a19b4e8, NAME => 'testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. service=AccessControlService 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. service=AccessControlService 2023-07-22 22:06:57,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:57,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,710 INFO [StoreOpener-691411ea4291b6b33044a5fc8a19b4e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,710 INFO [StoreOpener-a57e9da2a1876ca0c5128b272a178db9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,711 DEBUG [StoreOpener-691411ea4291b6b33044a5fc8a19b4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf 2023-07-22 22:06:57,711 DEBUG [StoreOpener-691411ea4291b6b33044a5fc8a19b4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf 2023-07-22 22:06:57,711 DEBUG [StoreOpener-a57e9da2a1876ca0c5128b272a178db9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf 2023-07-22 22:06:57,711 DEBUG [StoreOpener-a57e9da2a1876ca0c5128b272a178db9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf 2023-07-22 22:06:57,712 INFO [StoreOpener-691411ea4291b6b33044a5fc8a19b4e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 691411ea4291b6b33044a5fc8a19b4e8 columnFamilyName cf 2023-07-22 22:06:57,712 INFO [StoreOpener-a57e9da2a1876ca0c5128b272a178db9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a57e9da2a1876ca0c5128b272a178db9 columnFamilyName cf 2023-07-22 22:06:57,713 INFO [StoreOpener-691411ea4291b6b33044a5fc8a19b4e8-1] regionserver.HStore(310): Store=691411ea4291b6b33044a5fc8a19b4e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:57,713 INFO [StoreOpener-a57e9da2a1876ca0c5128b272a178db9-1] regionserver.HStore(310): Store=a57e9da2a1876ca0c5128b272a178db9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:57,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:06:57,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:06:57,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:57,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:57,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 691411ea4291b6b33044a5fc8a19b4e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73961072, jitterRate=0.10210585594177246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:57,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 691411ea4291b6b33044a5fc8a19b4e8: 2023-07-22 22:06:57,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a57e9da2a1876ca0c5128b272a178db9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72059241, jitterRate=0.07376636564731598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:57,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a57e9da2a1876ca0c5128b272a178db9: 2023-07-22 22:06:57,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9., pid=46, masterSystemTime=1690063617704 2023-07-22 22:06:57,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8., pid=45, masterSystemTime=1690063617704 2023-07-22 22:06:57,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:57,724 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=691411ea4291b6b33044a5fc8a19b4e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:57,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,724 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617723"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063617723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063617723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063617723"}]},"ts":"1690063617723"} 2023-07-22 22:06:57,724 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a57e9da2a1876ca0c5128b272a178db9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:57,724 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063617724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063617724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063617724"}]},"ts":"1690063617724"} 2023-07-22 22:06:57,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-22 22:06:57,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 691411ea4291b6b33044a5fc8a19b4e8, server=jenkins-hbase4.apache.org,45315,1690063572016 in 173 msec 2023-07-22 22:06:57,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-22 22:06:57,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a57e9da2a1876ca0c5128b272a178db9, server=jenkins-hbase4.apache.org,37263,1690063572153 in 173 msec 2023-07-22 22:06:57,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, ASSIGN in 335 msec 2023-07-22 22:06:57,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-22 22:06:57,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, ASSIGN in 336 msec 2023-07-22 22:06:57,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:57,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063617732"}]},"ts":"1690063617732"} 2023-07-22 22:06:57,733 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-22 22:06:57,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:57,736 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-22 22:06:57,738 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 22:06:57,739 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,739 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,739 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,739 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 396 msec 2023-07-22 22:06:57,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,959 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-22 22:06:57,961 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 22:06:57,962 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:57,965 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:57,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:57,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063617981 (current time:1690063617981). 2023-07-22 22:06:57,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:57,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x3b28ceda to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:57,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50fa82d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:57,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:57,998 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:57,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b28ceda to 127.0.0.1:62392 2023-07-22 22:06:57,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:58,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x2f3e4182 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@529d14a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:58,015 DEBUG [hconnection-0x5675d004-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,019 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,028 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f3e4182 to 127.0.0.1:62392 2023-07-22 22:06:58,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:58,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 22:06:58,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:58,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,034 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,035 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690064218035 2023-07-22 22:06:58,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 22:06:58,036 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:58,036 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:58,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,038 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-22 22:06:58,041 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,041 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690064218041 2023-07-22 22:06:58,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,060 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-22 22:06:58,060 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,061 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 22:06:58,062 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 22:06:58,062 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,062 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,063 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,064 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,064 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 22:06:58,065 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,065 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,065 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,065 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,065 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,067 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,067 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,067 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,067 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,068 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,068 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,068 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,067 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,070 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,070 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,070 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 22:06:58,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,071 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,071 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,071 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,071 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,071 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,071 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,075 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,075 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,075 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,076 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,076 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,076 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,077 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1a5c10[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:58,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1a5c10[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:58,080 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 22:06:58,080 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,081 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:58,081 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:58,081 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,081 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:58,082 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:58,081 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:58,082 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. started... 2023-07-22 22:06:58,082 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,082 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. started... 2023-07-22 22:06:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:06:58,082 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a57e9da2a1876ca0c5128b272a178db9: 2023-07-22 22:06:58,083 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 691411ea4291b6b33044a5fc8a19b4e8: 2023-07-22 22:06:58,083 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,083 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,084 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:58,084 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:58,084 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:58,084 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:58,089 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,090 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,090 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,099 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. completed. 2023-07-22 22:06:58,099 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:58,099 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:58,099 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:58,099 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,099 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,099 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:06:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,101 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,101 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. completed. 2023-07-22 22:06:58,104 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,104 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:58,104 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:58,104 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,104 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,104 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:06:58,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,106 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,106 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,106 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,106 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:06:58,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 22:06:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:06:58,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 22:06:58,114 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-22 22:06:58,114 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:58,114 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:58,114 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,114 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:58,115 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,116 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,116 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,117 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,117 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,124 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,124 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,124 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,129 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,129 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,131 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-22 22:06:58,131 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,131 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,131 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:06:58,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,132 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,132 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,132 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,132 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,132 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,132 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 22:06:58,137 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:58,138 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:58,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 22:06:58,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,201 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690063618035Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690063618140 (+105 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690063618140Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690063618141 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690063618145 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690063618154 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690063618201 (+47 ms) 2023-07-22 22:06:58,207 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 172 msec 2023-07-22 22:06:58,338 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:58,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37263] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:58,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45315] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:58,348 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 22:06:58,348 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:58,348 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:58,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063618361 (current time:1690063618361). 2023-07-22 22:06:58,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:58,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x4833a525 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:58,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24b0209e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:58,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,376 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4833a525 to 127.0.0.1:62392 2023-07-22 22:06:58,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:58,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x34f8ba87 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:58,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61b73bb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:58,386 DEBUG [hconnection-0x44a643c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,388 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,393 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34f8ba87 to 127.0.0.1:62392 2023-07-22 22:06:58,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:58,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 22:06:58,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:58,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,399 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,400 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690064218400 2023-07-22 22:06:58,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 22:06:58,402 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:58,402 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:58,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,404 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-22 22:06:58,407 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,408 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690064218408 2023-07-22 22:06:58,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-22 22:06:58,426 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-22 22:06:58,426 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,428 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 22:06:58,428 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 22:06:58,431 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,431 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,432 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,432 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,432 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,432 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,433 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,433 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,434 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,434 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,435 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,435 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,435 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,437 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,437 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,437 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,437 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,438 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,437 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,438 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,439 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,439 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,439 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,440 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,442 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,442 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,442 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,442 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,442 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,443 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,443 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,443 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,443 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,445 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,445 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,445 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,445 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:58,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3760bce8[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:58,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3760bce8[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:58,449 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 22:06:58,450 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,451 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,452 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,451 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,452 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:58,452 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:58,452 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:58,452 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,452 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. started... 2023-07-22 22:06:58,452 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,452 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:58,452 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,452 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:06:58,452 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a57e9da2a1876ca0c5128b272a178db9 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-22 22:06:58,454 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,454 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,454 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,460 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:58,460 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:58,460 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:58,461 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. started... 2023-07-22 22:06:58,461 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 691411ea4291b6b33044a5fc8a19b4e8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-22 22:06:58,502 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:58,504 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:58,510 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722ba74eb9c01974ffe893a75f0f9a9f15b to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722ba74eb9c01974ffe893a75f0f9a9f15b 2023-07-22 22:06:58,514 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307222f2cda0b619e46c29c3ce7ecfc6f49b8 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307222f2cda0b619e46c29c3ce7ecfc6f49b8 2023-07-22 22:06:58,530 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/.tmp/cf/c326a1f8aea8498da7d3e336cfb879ae 2023-07-22 22:06:58,531 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/.tmp/cf/cffee5ae061443ea99fa74d89470fa22 2023-07-22 22:06:58,537 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/.tmp/cf/c326a1f8aea8498da7d3e336cfb879ae as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf/c326a1f8aea8498da7d3e336cfb879ae 2023-07-22 22:06:58,540 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/.tmp/cf/cffee5ae061443ea99fa74d89470fa22 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf/cffee5ae061443ea99fa74d89470fa22 2023-07-22 22:06:58,543 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf/c326a1f8aea8498da7d3e336cfb879ae, entries=45, sequenceid=6, filesize=12.4 K 2023-07-22 22:06:58,544 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 691411ea4291b6b33044a5fc8a19b4e8 in 83ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:58,544 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 22:06:58,545 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 691411ea4291b6b33044a5fc8a19b4e8: 2023-07-22 22:06:58,545 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,545 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:58,545 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf/c326a1f8aea8498da7d3e336cfb879ae] hfiles 2023-07-22 22:06:58,545 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf/c326a1f8aea8498da7d3e336cfb879ae for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,555 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf/cffee5ae061443ea99fa74d89470fa22, entries=5, sequenceid=6, filesize=5.7 K 2023-07-22 22:06:58,559 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a57e9da2a1876ca0c5128b272a178db9 in 107ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:58,564 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a57e9da2a1876ca0c5128b272a178db9: 2023-07-22 22:06:58,564 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,564 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:58,564 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf/cffee5ae061443ea99fa74d89470fa22] hfiles 2023-07-22 22:06:58,565 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf/cffee5ae061443ea99fa74d89470fa22 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,579 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. completed. 2023-07-22 22:06:58,579 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:06:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:06:58,581 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:06:58,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 22:06:58,595 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. completed. 2023-07-22 22:06:58,596 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:06:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:06:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,602 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:06:58,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 22:06:58,607 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-22 22:06:58,607 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:58,607 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:58,607 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,607 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,609 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,609 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,610 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,611 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,613 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,614 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,615 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,621 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,621 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,621 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,622 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-22 22:06:58,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,622 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,622 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,622 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:06:58,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-22 22:06:58,624 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,625 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307222f2cda0b619e46c29c3ce7ecfc6f49b8, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722ba74eb9c01974ffe893a75f0f9a9f15b] mob files 2023-07-22 22:06:58,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307222f2cda0b619e46c29c3ce7ecfc6f49b8 2023-07-22 22:06:58,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722ba74eb9c01974ffe893a75f0f9a9f15b 2023-07-22 22:06:58,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-22 22:06:58,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,704 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:58,706 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:59,006 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:59,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:59,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:59,008 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 22:06:59,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 22:06:59,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:59,112 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:59,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690063618400Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690063618640 (+240 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690063618640Loading Region manifests for snaptb0-testConsecutiveExports at 1690063618640Writing data manifest for snaptb0-testConsecutiveExports at 1690063618645 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690063618664 (+19 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690063619111 (+447 ms) 2023-07-22 22:06:59,115 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:59,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 713 msec 2023-07-22 22:06:59,508 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:59,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:59,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:59,509 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509 2023-07-22 22:06:59,509 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:59,531 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:06:59,531 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2e9517fa, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:59,531 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 22:06:59,540 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:59,552 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,553 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,553 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,554 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,554 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,554 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,554 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,627 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-6900734710351663632.jar 2023-07-22 22:06:59,628 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,628 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,628 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,629 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,629 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,629 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:59,630 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:06:59,630 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:06:59,630 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:06:59,631 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:06:59,631 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:06:59,632 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:06:59,632 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:06:59,632 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:06:59,633 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:06:59,633 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:06:59,634 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:59,634 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:59,635 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:59,635 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:59,635 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:59,636 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:59,636 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:00,398 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:00,401 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 22:07:00,403 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-22 22:07:01,933 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:01,933 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:01,936 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0002_000001 (auth:SIMPLE) 2023-07-22 22:07:02,070 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:02,652 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:07:06,763 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:09,040 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:12,266 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:12,278 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690063579916_0003_01_000002 is : 143 2023-07-22 22:07:13,593 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:07:13,593 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:07:13,597 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 22:07:13,597 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:07:13,598 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:07:13,598 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:13,600 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:13,601 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:13,601 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@de55ebb in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:13,601 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:13,601 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:13,602 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:07:13,624 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:07:13,624 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1bdc3c9c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:07:13,624 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 22:07:13,636 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:07:13,649 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,649 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,650 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,650 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,651 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,651 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,652 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,737 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-3860557265368708845.jar 2023-07-22 22:07:13,737 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,738 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,738 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,738 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,739 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,739 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:13,739 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:07:13,740 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:07:13,740 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:07:13,740 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:07:13,741 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:07:13,741 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:07:13,742 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:07:13,742 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:07:13,742 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:07:13,743 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:07:13,743 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:13,743 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:13,744 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:13,744 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:13,744 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:13,744 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:13,745 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:14,122 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:14,124 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 22:07:14,127 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-22 22:07:18,438 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:18,438 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:18,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:19,303 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:23,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:26,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:30,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:32,336 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:07:32,336 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:07:32,340 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 22:07:32,341 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:07:32,341 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:07:32,341 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:32,344 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:32,344 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:32,344 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@de55ebb in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:32,344 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:32,344 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/local-export-1690063619509/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:32,365 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-22 22:07:32,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-22 22:07:32,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 22:07:32,373 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063652372"}]},"ts":"1690063652372"} 2023-07-22 22:07:32,379 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-22 22:07:32,381 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-22 22:07:32,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, UNASSIGN}] 2023-07-22 22:07:32,384 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, UNASSIGN 2023-07-22 22:07:32,386 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, UNASSIGN 2023-07-22 22:07:32,388 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=691411ea4291b6b33044a5fc8a19b4e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:32,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a57e9da2a1876ca0c5128b272a178db9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:32,388 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063652388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063652388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063652388"}]},"ts":"1690063652388"} 2023-07-22 22:07:32,388 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063652388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063652388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063652388"}]},"ts":"1690063652388"} 2023-07-22 22:07:32,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 691411ea4291b6b33044a5fc8a19b4e8, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:07:32,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure a57e9da2a1876ca0c5128b272a178db9, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:07:32,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 22:07:32,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:07:32,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 691411ea4291b6b33044a5fc8a19b4e8, disabling compactions & flushes 2023-07-22 22:07:32,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:07:32,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:07:32,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. after waiting 0 ms 2023-07-22 22:07:32,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:07:32,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:07:32,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a57e9da2a1876ca0c5128b272a178db9, disabling compactions & flushes 2023-07-22 22:07:32,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:07:32,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:07:32,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. after waiting 0 ms 2023-07-22 22:07:32,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:07:32,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:32,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:32,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:32,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9. 2023-07-22 22:07:32,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a57e9da2a1876ca0c5128b272a178db9: 2023-07-22 22:07:32,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:32,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8. 2023-07-22 22:07:32,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 691411ea4291b6b33044a5fc8a19b4e8: 2023-07-22 22:07:32,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:07:32,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a57e9da2a1876ca0c5128b272a178db9, regionState=CLOSED 2023-07-22 22:07:32,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:07:32,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063652584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063652584"}]},"ts":"1690063652584"} 2023-07-22 22:07:32,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=691411ea4291b6b33044a5fc8a19b4e8, regionState=CLOSED 2023-07-22 22:07:32,586 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063652585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063652585"}]},"ts":"1690063652585"} 2023-07-22 22:07:32,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-22 22:07:32,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure a57e9da2a1876ca0c5128b272a178db9, server=jenkins-hbase4.apache.org,37263,1690063572153 in 194 msec 2023-07-22 22:07:32,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-22 22:07:32,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 691411ea4291b6b33044a5fc8a19b4e8, server=jenkins-hbase4.apache.org,45315,1690063572016 in 197 msec 2023-07-22 22:07:32,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a57e9da2a1876ca0c5128b272a178db9, UNASSIGN in 209 msec 2023-07-22 22:07:32,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-22 22:07:32,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=691411ea4291b6b33044a5fc8a19b4e8, UNASSIGN in 210 msec 2023-07-22 22:07:32,595 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063652595"}]},"ts":"1690063652595"} 2023-07-22 22:07:32,596 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-22 22:07:32,598 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-22 22:07:32,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 234 msec 2023-07-22 22:07:32,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 22:07:32,674 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-22 22:07:32,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-22 22:07:32,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-22 22:07:32,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,683 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-22 22:07:32,685 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,685 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,686 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,686 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:32,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:32,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:32,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:32,687 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:07:32,688 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:32,689 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:32,689 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/recovered.edits] 2023-07-22 22:07:32,690 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/recovered.edits] 2023-07-22 22:07:32,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 22:07:32,696 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf/c326a1f8aea8498da7d3e336cfb879ae to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/cf/c326a1f8aea8498da7d3e336cfb879ae 2023-07-22 22:07:32,697 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf/cffee5ae061443ea99fa74d89470fa22 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/cf/cffee5ae061443ea99fa74d89470fa22 2023-07-22 22:07:32,700 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8/recovered.edits/9.seqid 2023-07-22 22:07:32,700 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9/recovered.edits/9.seqid 2023-07-22 22:07:32,701 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/691411ea4291b6b33044a5fc8a19b4e8 2023-07-22 22:07:32,701 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testConsecutiveExports/a57e9da2a1876ca0c5128b272a178db9 2023-07-22 22:07:32,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 22:07:32,701 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-22 22:07:32,702 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-22 22:07:32,706 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307222f2cda0b619e46c29c3ce7ecfc6f49b8 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307222f2cda0b619e46c29c3ce7ecfc6f49b8 2023-07-22 22:07:32,708 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722ba74eb9c01974ffe893a75f0f9a9f15b to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722ba74eb9c01974ffe893a75f0f9a9f15b 2023-07-22 22:07:32,708 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-22 22:07:32,711 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,713 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-22 22:07:32,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-22 22:07:32,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-22 22:07:32,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063652717"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:32,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063652717"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:32,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:07:32,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a57e9da2a1876ca0c5128b272a178db9, NAME => 'testtb-testConsecutiveExports,,1690063617349.a57e9da2a1876ca0c5128b272a178db9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 691411ea4291b6b33044a5fc8a19b4e8, NAME => 'testtb-testConsecutiveExports,1,1690063617349.691411ea4291b6b33044a5fc8a19b4e8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:07:32,719 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-22 22:07:32,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063652719"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:32,721 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-22 22:07:32,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:32,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 48 msec 2023-07-22 22:07:32,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 22:07:32,793 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-22 22:07:32,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-22 22:07:32,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-22 22:07:32,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-22 22:07:32,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-22 22:07:32,832 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 768), OpenFileDescriptor=896 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=492 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6106 (was 6450) 2023-07-22 22:07:32,833 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-22 22:07:32,852 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=492, ProcessCount=180, AvailableMemoryMB=6106 2023-07-22 22:07:32,852 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-22 22:07:32,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 22:07:32,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,856 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:07:32,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-22 22:07:32,857 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:07:32,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:32,860 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:32,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:32,861 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea empty. 2023-07-22 22:07:32,861 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e empty. 2023-07-22 22:07:32,861 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:32,861 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:32,861 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 22:07:32,879 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-22 22:07:32,880 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02c3802dad988aae3809d4961d7635ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:07:32,881 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f1cdee5d58f65a8c55230de53a32976e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:07:32,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:32,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:32,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f1cdee5d58f65a8c55230de53a32976e, disabling compactions & flushes 2023-07-22 22:07:32,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 02c3802dad988aae3809d4961d7635ea, disabling compactions & flushes 2023-07-22 22:07:32,894 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:32,894 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:32,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:32,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:32,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. after waiting 0 ms 2023-07-22 22:07:32,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:32,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. after waiting 0 ms 2023-07-22 22:07:32,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:32,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:32,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:32,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 02c3802dad988aae3809d4961d7635ea: 2023-07-22 22:07:32,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f1cdee5d58f65a8c55230de53a32976e: 2023-07-22 22:07:32,897 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:07:32,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063652898"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063652898"}]},"ts":"1690063652898"} 2023-07-22 22:07:32,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063652898"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063652898"}]},"ts":"1690063652898"} 2023-07-22 22:07:32,905 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:07:32,906 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:07:32,906 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063652906"}]},"ts":"1690063652906"} 2023-07-22 22:07:32,908 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-22 22:07:32,911 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:07:32,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:07:32,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:07:32,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:07:32,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:07:32,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, ASSIGN}] 2023-07-22 22:07:32,915 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, ASSIGN 2023-07-22 22:07:32,916 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, ASSIGN 2023-07-22 22:07:32,916 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37263,1690063572153; forceNewPlan=false, retain=false 2023-07-22 22:07:32,916 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33875,1690063572086; forceNewPlan=false, retain=false 2023-07-22 22:07:32,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:33,067 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:07:33,069 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f1cdee5d58f65a8c55230de53a32976e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,069 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=02c3802dad988aae3809d4961d7635ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,070 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063653069"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063653069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063653069"}]},"ts":"1690063653069"} 2023-07-22 22:07:33,070 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063653069"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063653069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063653069"}]},"ts":"1690063653069"} 2023-07-22 22:07:33,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure f1cdee5d58f65a8c55230de53a32976e, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:07:33,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 02c3802dad988aae3809d4961d7635ea, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:07:33,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:33,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:33,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1cdee5d58f65a8c55230de53a32976e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:07:33,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. service=AccessControlService 2023-07-22 22:07:33,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:33,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:33,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02c3802dad988aae3809d4961d7635ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:07:33,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. service=AccessControlService 2023-07-22 22:07:33,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:33,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:33,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,233 INFO [StoreOpener-02c3802dad988aae3809d4961d7635ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,235 INFO [StoreOpener-f1cdee5d58f65a8c55230de53a32976e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,235 DEBUG [StoreOpener-02c3802dad988aae3809d4961d7635ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf 2023-07-22 22:07:33,235 DEBUG [StoreOpener-02c3802dad988aae3809d4961d7635ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf 2023-07-22 22:07:33,237 DEBUG [StoreOpener-f1cdee5d58f65a8c55230de53a32976e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf 2023-07-22 22:07:33,237 DEBUG [StoreOpener-f1cdee5d58f65a8c55230de53a32976e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf 2023-07-22 22:07:33,237 INFO [StoreOpener-02c3802dad988aae3809d4961d7635ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02c3802dad988aae3809d4961d7635ea columnFamilyName cf 2023-07-22 22:07:33,237 INFO [StoreOpener-f1cdee5d58f65a8c55230de53a32976e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1cdee5d58f65a8c55230de53a32976e columnFamilyName cf 2023-07-22 22:07:33,249 INFO [StoreOpener-02c3802dad988aae3809d4961d7635ea-1] regionserver.HStore(310): Store=02c3802dad988aae3809d4961d7635ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:33,250 INFO [StoreOpener-f1cdee5d58f65a8c55230de53a32976e-1] regionserver.HStore(310): Store=f1cdee5d58f65a8c55230de53a32976e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:33,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:33,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:33,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1cdee5d58f65a8c55230de53a32976e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67322012, jitterRate=0.0031761527061462402}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:33,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1cdee5d58f65a8c55230de53a32976e: 2023-07-22 22:07:33,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e., pid=60, masterSystemTime=1690063653223 2023-07-22 22:07:33,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f1cdee5d58f65a8c55230de53a32976e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,266 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063653266"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063653266"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063653266"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063653266"}]},"ts":"1690063653266"} 2023-07-22 22:07:33,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:33,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:33,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-22 22:07:33,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure f1cdee5d58f65a8c55230de53a32976e, server=jenkins-hbase4.apache.org,37263,1690063572153 in 197 msec 2023-07-22 22:07:33,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, ASSIGN in 360 msec 2023-07-22 22:07:33,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:33,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02c3802dad988aae3809d4961d7635ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61891441, jitterRate=-0.07774566113948822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:33,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02c3802dad988aae3809d4961d7635ea: 2023-07-22 22:07:33,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea., pid=61, masterSystemTime=1690063653224 2023-07-22 22:07:33,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,288 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=02c3802dad988aae3809d4961d7635ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,288 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063653288"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063653288"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063653288"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063653288"}]},"ts":"1690063653288"} 2023-07-22 22:07:33,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-22 22:07:33,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 02c3802dad988aae3809d4961d7635ea, server=jenkins-hbase4.apache.org,33875,1690063572086 in 218 msec 2023-07-22 22:07:33,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-22 22:07:33,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, ASSIGN in 380 msec 2023-07-22 22:07:33,296 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:07:33,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063653296"}]},"ts":"1690063653296"} 2023-07-22 22:07:33,297 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-22 22:07:33,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:07:33,300 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-22 22:07:33,302 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 22:07:33,303 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,303 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,303 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,303 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 452 msec 2023-07-22 22:07:33,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:33,461 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-22 22:07:33,463 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,464 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,466 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:33,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:33,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063653480 (current time:1690063653480). 2023-07-22 22:07:33,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:33,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x6b99ef77 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:33,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a50344, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:33,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:33,495 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:33,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b99ef77 to 127.0.0.1:62392 2023-07-22 22:07:33,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:33,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x633c6c4a to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:33,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@477ac50d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:33,605 DEBUG [hconnection-0x4f4d5185-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:33,606 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:33,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:33,616 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x633c6c4a to 127.0.0.1:62392 2023-07-22 22:07:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 22:07:33,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:33,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:33,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:33,629 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:33,630 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690064253630 2023-07-22 22:07:33,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:33,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,634 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:33,634 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:33,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:33,638 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:33,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 13 msec 2023-07-22 22:07:33,640 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:33,641 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690064253641 2023-07-22 22:07:33,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,694 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:33,694 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:33,697 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 22:07:33,697 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 22:07:33,725 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,725 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,726 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:33,727 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:33,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:33,727 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:33,727 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:33,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,727 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,728 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,728 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,728 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:33,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 22:07:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:33,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:33,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,734 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:33,734 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:33,734 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:33,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:33,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:33,736 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:33,744 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,744 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:33,751 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:33,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:33,753 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:33,753 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:33,753 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:33,753 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:33,753 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:33,754 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:33,758 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,758 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,759 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:33,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:33,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e96a5dd[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:33,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:33,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:33,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:33,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e96a5dd[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:33,767 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 22:07:33,767 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,768 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,768 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:07:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:33,769 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,770 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,770 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:33,773 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:33,773 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. started... 2023-07-22 22:07:33,775 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1cdee5d58f65a8c55230de53a32976e: 2023-07-22 22:07:33,775 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. started... 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02c3802dad988aae3809d4961d7635ea: 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,775 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:33,776 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:33,803 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. completed. 2023-07-22 22:07:33,803 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:33,803 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:33,803 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:07:33,805 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. completed. 2023-07-22 22:07:33,805 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,805 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:33,805 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:33,805 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,805 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,805 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:33,805 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:07:33,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:33,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:33,809 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:33,809 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:33,809 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:33,809 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:07:33,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 22:07:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:07:33,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 22:07:33,817 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 22:07:33,818 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:33,818 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:33,818 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,818 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:33,820 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:33,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:33,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:33,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,823 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,824 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:33,824 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:33,826 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,826 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,827 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:33,833 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,834 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:33,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:33,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:33,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:33,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:33,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:33,836 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:33,834 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:33,836 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:33,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:33,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,836 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:33,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:33,836 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:33,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:07:33,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:33,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 22:07:33,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 22:07:33,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,899 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690063653630Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690063653846 (+216 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063653846Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063653847 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063653851 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063653865 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690063653899 (+34 ms) 2023-07-22 22:07:33,902 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:33,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 268 msec 2023-07-22 22:07:33,936 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:33,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:33,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:33,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33875] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:33,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37263] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:33,950 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:33,951 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:33,951 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:33,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:33,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063653965 (current time:1690063653965). 2023-07-22 22:07:33,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:33,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x00b5c126 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@532f9085, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:33,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:33,990 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:33,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00b5c126 to 127.0.0.1:62392 2023-07-22 22:07:33,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:33,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x5d2be74c to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:34,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73b9b13e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:34,008 DEBUG [hconnection-0x5c3dbc74-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:34,012 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:34,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:34,038 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:34,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d2be74c to 127.0.0.1:62392 2023-07-22 22:07:34,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:34,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 22:07:34,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:34,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:34,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:34,044 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:34,045 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690064254045 2023-07-22 22:07:34,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:34,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,047 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:34,048 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:34,048 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:34,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:34,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-22 22:07:34,049 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:34,050 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690064254050 2023-07-22 22:07:34,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,087 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:34,087 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:34,088 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 22:07:34,088 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 22:07:34,145 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,145 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,146 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:34,146 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:34,146 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:34,146 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:34,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:34,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:34,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:34,147 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,147 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,147 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,148 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:34,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,148 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:34,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 22:07:34,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:34,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:34,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,149 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:34,149 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:34,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 22:07:34,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 22:07:34,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,151 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:34,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:34,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:34,151 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:34,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,151 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:34,151 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:34,151 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:34,151 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:34,152 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:34,152 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:34,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:34,152 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:34,154 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,154 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,154 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:34,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,154 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:34,155 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:34,155 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:34,155 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:34,156 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:34,157 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,157 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:34,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:34,159 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,159 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,160 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:34,160 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:34,160 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,160 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:34,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:34,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:34,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:34,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d342f7[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:34,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:34,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:34,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:34,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:34,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d342f7[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:34,167 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 22:07:34,167 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:34,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,169 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:34,169 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:34,169 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,169 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. started... 2023-07-22 22:07:34,170 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:34,170 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:34,169 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:34,170 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,170 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:34,170 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02c3802dad988aae3809d4961d7635ea 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-22 22:07:34,170 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:07:34,170 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:34,170 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. started... 2023-07-22 22:07:34,170 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:34,170 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:34,170 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f1cdee5d58f65a8c55230de53a32976e 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-22 22:07:34,172 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:34,172 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:34,172 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:34,223 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722d3a827d6701b45d7a479cb2bd2208097 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722d3a827d6701b45d7a479cb2bd2208097 2023-07-22 22:07:34,229 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722b84c6578985641d9814d0be01718e7b2 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722b84c6578985641d9814d0be01718e7b2 2023-07-22 22:07:34,247 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/.tmp/cf/05a9cb3834834025adb06c007dc2109c 2023-07-22 22:07:34,253 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/.tmp/cf/05a9cb3834834025adb06c007dc2109c as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf/05a9cb3834834025adb06c007dc2109c 2023-07-22 22:07:34,258 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf/05a9cb3834834025adb06c007dc2109c, entries=2, sequenceid=6, filesize=5.3 K 2023-07-22 22:07:34,259 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 02c3802dad988aae3809d4961d7635ea in 89ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:34,259 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:34,259 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02c3802dad988aae3809d4961d7635ea: 2023-07-22 22:07:34,260 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,260 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:34,260 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf/05a9cb3834834025adb06c007dc2109c] hfiles 2023-07-22 22:07:34,260 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf/05a9cb3834834025adb06c007dc2109c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,271 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/.tmp/cf/a6674b3f1c554b0d8c7759f7d6a65ccb 2023-07-22 22:07:34,285 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/.tmp/cf/a6674b3f1c554b0d8c7759f7d6a65ccb as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf/a6674b3f1c554b0d8c7759f7d6a65ccb 2023-07-22 22:07:34,287 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. completed. 2023-07-22 22:07:34,287 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:34,287 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:34,287 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:34,287 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,287 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:34,287 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:07:34,289 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:34,289 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,289 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:34,289 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:34,297 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf/a6674b3f1c554b0d8c7759f7d6a65ccb, entries=48, sequenceid=6, filesize=13.7 K 2023-07-22 22:07:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:07:34,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 22:07:34,300 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f1cdee5d58f65a8c55230de53a32976e in 130ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:34,302 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1cdee5d58f65a8c55230de53a32976e: 2023-07-22 22:07:34,302 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,302 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:34,302 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf/a6674b3f1c554b0d8c7759f7d6a65ccb] hfiles 2023-07-22 22:07:34,302 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf/a6674b3f1c554b0d8c7759f7d6a65ccb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,317 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. completed. 2023-07-22 22:07:34,317 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:34,317 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:34,317 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:34,317 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,318 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:34,318 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:07:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:34,320 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:07:34,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 22:07:34,326 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 22:07:34,326 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:34,326 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:34,326 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,326 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:34,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:34,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,336 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:34,336 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:34,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,336 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,337 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:34,337 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:34,342 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,343 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,343 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,346 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:34,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:34,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:34,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:34,347 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:34,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,347 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:34,349 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:34,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:34,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,350 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,350 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,350 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,349 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:34,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:34,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:34,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:34,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:34,350 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:34,350 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:07:34,350 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:34,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:34,351 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,351 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:34,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722b84c6578985641d9814d0be01718e7b2, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722d3a827d6701b45d7a479cb2bd2208097] mob files 2023-07-22 22:07:34,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722b84c6578985641d9814d0be01718e7b2 2023-07-22 22:07:34,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722d3a827d6701b45d7a479cb2bd2208097 2023-07-22 22:07:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:34,353 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:07:34,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,420 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 22:07:34,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,420 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:34,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690063654046Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690063654359 (+313 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690063654359Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690063654359Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690063654368 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690063654381 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690063654420 (+39 ms) 2023-07-22 22:07:34,423 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:34,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 376 msec 2023-07-22 22:07:34,653 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:34,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:34,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:34,690 DEBUG [Listener at jenkins-hbase4.apache.org/46525] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:07:34,695 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:07:34,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33875] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 22:07:34,697 DEBUG [Listener at jenkins-hbase4.apache.org/46525] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:07:34,703 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:07:34,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37263] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 22:07:34,704 DEBUG [Listener at jenkins-hbase4.apache.org/46525] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:07:34,710 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:07:34,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45315] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 22:07:34,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:07:34,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:34,717 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:07:34,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-22 22:07:34,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:34,720 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:07:34,723 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:34,724 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e empty. 2023-07-22 22:07:34,724 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:34,725 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:34,725 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a empty. 2023-07-22 22:07:34,725 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:34,725 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 22:07:34,745 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-22 22:07:34,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 56b6c81bac4f0400c0088caec4d7108e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:07:34,747 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2987c42b154e4d4c3e7f974fe301ab7a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:07:34,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:34,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 56b6c81bac4f0400c0088caec4d7108e, disabling compactions & flushes 2023-07-22 22:07:34,757 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:34,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:34,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. after waiting 0 ms 2023-07-22 22:07:34,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:34,758 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 56b6c81bac4f0400c0088caec4d7108e: 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 2987c42b154e4d4c3e7f974fe301ab7a, disabling compactions & flushes 2023-07-22 22:07:34,758 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. after waiting 0 ms 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:34,758 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:34,758 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 2987c42b154e4d4c3e7f974fe301ab7a: 2023-07-22 22:07:34,761 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:07:34,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063654762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063654762"}]},"ts":"1690063654762"} 2023-07-22 22:07:34,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063654762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063654762"}]},"ts":"1690063654762"} 2023-07-22 22:07:34,765 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:07:34,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:07:34,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063654771"}]},"ts":"1690063654771"} 2023-07-22 22:07:34,772 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-22 22:07:34,776 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:07:34,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:07:34,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:07:34,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:07:34,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:07:34,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, ASSIGN}] 2023-07-22 22:07:34,780 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, ASSIGN 2023-07-22 22:07:34,780 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, ASSIGN 2023-07-22 22:07:34,781 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33875,1690063572086; forceNewPlan=false, retain=false 2023-07-22 22:07:34,781 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:07:34,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:34,931 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:07:34,934 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2987c42b154e4d4c3e7f974fe301ab7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:34,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=56b6c81bac4f0400c0088caec4d7108e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:34,934 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063654934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063654934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063654934"}]},"ts":"1690063654934"} 2023-07-22 22:07:34,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063654934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063654934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063654934"}]},"ts":"1690063654934"} 2023-07-22 22:07:34,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 2987c42b154e4d4c3e7f974fe301ab7a, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:07:34,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 56b6c81bac4f0400c0088caec4d7108e, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:07:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:35,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2987c42b154e4d4c3e7f974fe301ab7a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.', STARTKEY => '2', ENDKEY => ''} 2023-07-22 22:07:35,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56b6c81bac4f0400c0088caec4d7108e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.', STARTKEY => '', ENDKEY => '2'} 2023-07-22 22:07:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. service=AccessControlService 2023-07-22 22:07:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. service=AccessControlService 2023-07-22 22:07:35,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:35,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:35,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,096 INFO [StoreOpener-56b6c81bac4f0400c0088caec4d7108e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,099 INFO [StoreOpener-2987c42b154e4d4c3e7f974fe301ab7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,100 DEBUG [StoreOpener-56b6c81bac4f0400c0088caec4d7108e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf 2023-07-22 22:07:35,100 DEBUG [StoreOpener-56b6c81bac4f0400c0088caec4d7108e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf 2023-07-22 22:07:35,100 DEBUG [StoreOpener-2987c42b154e4d4c3e7f974fe301ab7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf 2023-07-22 22:07:35,100 DEBUG [StoreOpener-2987c42b154e4d4c3e7f974fe301ab7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf 2023-07-22 22:07:35,100 INFO [StoreOpener-56b6c81bac4f0400c0088caec4d7108e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56b6c81bac4f0400c0088caec4d7108e columnFamilyName cf 2023-07-22 22:07:35,101 INFO [StoreOpener-2987c42b154e4d4c3e7f974fe301ab7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2987c42b154e4d4c3e7f974fe301ab7a columnFamilyName cf 2023-07-22 22:07:35,101 INFO [StoreOpener-56b6c81bac4f0400c0088caec4d7108e-1] regionserver.HStore(310): Store=56b6c81bac4f0400c0088caec4d7108e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:35,101 INFO [StoreOpener-2987c42b154e4d4c3e7f974fe301ab7a-1] regionserver.HStore(310): Store=2987c42b154e4d4c3e7f974fe301ab7a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:35,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:35,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:35,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 56b6c81bac4f0400c0088caec4d7108e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59469592, jitterRate=-0.11383402347564697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:35,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 56b6c81bac4f0400c0088caec4d7108e: 2023-07-22 22:07:35,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2987c42b154e4d4c3e7f974fe301ab7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75250633, jitterRate=0.12132181227207184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:35,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2987c42b154e4d4c3e7f974fe301ab7a: 2023-07-22 22:07:35,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a., pid=69, masterSystemTime=1690063655088 2023-07-22 22:07:35,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e., pid=70, masterSystemTime=1690063655089 2023-07-22 22:07:35,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,113 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2987c42b154e4d4c3e7f974fe301ab7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:35,113 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063655113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063655113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063655113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063655113"}]},"ts":"1690063655113"} 2023-07-22 22:07:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,114 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=56b6c81bac4f0400c0088caec4d7108e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:35,114 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063655114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063655114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063655114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063655114"}]},"ts":"1690063655114"} 2023-07-22 22:07:35,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-22 22:07:35,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 2987c42b154e4d4c3e7f974fe301ab7a, server=jenkins-hbase4.apache.org,33875,1690063572086 in 179 msec 2023-07-22 22:07:35,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, ASSIGN in 339 msec 2023-07-22 22:07:35,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-22 22:07:35,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 56b6c81bac4f0400c0088caec4d7108e, server=jenkins-hbase4.apache.org,45315,1690063572016 in 181 msec 2023-07-22 22:07:35,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-22 22:07:35,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, ASSIGN in 345 msec 2023-07-22 22:07:35,125 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:07:35,126 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063655126"}]},"ts":"1690063655126"} 2023-07-22 22:07:35,127 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-22 22:07:35,130 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:07:35,130 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-22 22:07:35,132 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 22:07:35,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:35,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:35,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:35,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:35,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:35,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 423 msec 2023-07-22 22:07:35,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:35,323 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-22 22:07:35,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 56b6c81bac4f0400c0088caec4d7108e, 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[56b6c81bac4f0400c0088caec4d7108e, 2987c42b154e4d4c3e7f974fe301ab7a], force=true 2023-07-22 22:07:35,366 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[56b6c81bac4f0400c0088caec4d7108e, 2987c42b154e4d4c3e7f974fe301ab7a], force=true 2023-07-22 22:07:35,366 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[56b6c81bac4f0400c0088caec4d7108e, 2987c42b154e4d4c3e7f974fe301ab7a], force=true 2023-07-22 22:07:35,366 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[56b6c81bac4f0400c0088caec4d7108e, 2987c42b154e4d4c3e7f974fe301ab7a], force=true 2023-07-22 22:07:35,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:35,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, UNASSIGN}] 2023-07-22 22:07:35,409 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, UNASSIGN 2023-07-22 22:07:35,410 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, UNASSIGN 2023-07-22 22:07:35,411 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2987c42b154e4d4c3e7f974fe301ab7a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:35,411 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=56b6c81bac4f0400c0088caec4d7108e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:35,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063655411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063655411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063655411"}]},"ts":"1690063655411"} 2023-07-22 22:07:35,411 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063655411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063655411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063655411"}]},"ts":"1690063655411"} 2023-07-22 22:07:35,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 2987c42b154e4d4c3e7f974fe301ab7a, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:07:35,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 56b6c81bac4f0400c0088caec4d7108e, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:07:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:35,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 56b6c81bac4f0400c0088caec4d7108e, disabling compactions & flushes 2023-07-22 22:07:35,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2987c42b154e4d4c3e7f974fe301ab7a, disabling compactions & flushes 2023-07-22 22:07:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. after waiting 0 ms 2023-07-22 22:07:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. after waiting 0 ms 2023-07-22 22:07:35,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 56b6c81bac4f0400c0088caec4d7108e 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 22:07:35,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2987c42b154e4d4c3e7f974fe301ab7a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 22:07:35,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/.tmp/cf/70a1319b6674491d999c2289646fe4f8 2023-07-22 22:07:35,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/.tmp/cf/44463ff3e8e443b4a394b6b925ff412a 2023-07-22 22:07:35,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/.tmp/cf/70a1319b6674491d999c2289646fe4f8 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf/70a1319b6674491d999c2289646fe4f8 2023-07-22 22:07:35,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/.tmp/cf/44463ff3e8e443b4a394b6b925ff412a as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf/44463ff3e8e443b4a394b6b925ff412a 2023-07-22 22:07:35,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf/70a1319b6674491d999c2289646fe4f8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 22:07:35,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2987c42b154e4d4c3e7f974fe301ab7a in 53ms, sequenceid=5, compaction requested=false 2023-07-22 22:07:35,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 22:07:35,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf/44463ff3e8e443b4a394b6b925ff412a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 22:07:35,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 56b6c81bac4f0400c0088caec4d7108e in 63ms, sequenceid=5, compaction requested=false 2023-07-22 22:07:35,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 22:07:35,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:35,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a. 2023-07-22 22:07:35,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2987c42b154e4d4c3e7f974fe301ab7a: 2023-07-22 22:07:35,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:35,639 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2987c42b154e4d4c3e7f974fe301ab7a, regionState=CLOSED 2023-07-22 22:07:35,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063655639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063655639"}]},"ts":"1690063655639"} 2023-07-22 22:07:35,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 22:07:35,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:35,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e. 2023-07-22 22:07:35,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 56b6c81bac4f0400c0088caec4d7108e: 2023-07-22 22:07:35,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-22 22:07:35,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 2987c42b154e4d4c3e7f974fe301ab7a, server=jenkins-hbase4.apache.org,33875,1690063572086 in 230 msec 2023-07-22 22:07:35,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:35,647 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=56b6c81bac4f0400c0088caec4d7108e, regionState=CLOSED 2023-07-22 22:07:35,647 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063655647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063655647"}]},"ts":"1690063655647"} 2023-07-22 22:07:35,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2987c42b154e4d4c3e7f974fe301ab7a, UNASSIGN in 245 msec 2023-07-22 22:07:35,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-22 22:07:35,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 56b6c81bac4f0400c0088caec4d7108e, server=jenkins-hbase4.apache.org,45315,1690063572016 in 234 msec 2023-07-22 22:07:35,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-22 22:07:35,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=56b6c81bac4f0400c0088caec4d7108e, UNASSIGN in 257 msec 2023-07-22 22:07:35,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:35,749 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-22 22:07:35,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654713.56b6c81bac4f0400c0088caec4d7108e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:35,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063654713.2987c42b154e4d4c3e7f974fe301ab7a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:35,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:35,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, ASSIGN}] 2023-07-22 22:07:35,836 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, ASSIGN 2023-07-22 22:07:35,838 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:07:35,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:35,988 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 22:07:35,990 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d599adbb1e1233229653cffd6ae12efd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:35,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063655990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063655990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063655990"}]},"ts":"1690063655990"} 2023-07-22 22:07:35,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure d599adbb1e1233229653cffd6ae12efd, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:07:36,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:36,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d599adbb1e1233229653cffd6ae12efd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:07:36,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. service=AccessControlService 2023-07-22 22:07:36,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/.regioninfo 2023-07-22 22:07:36,173 INFO [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,175 DEBUG [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf 2023-07-22 22:07:36,175 DEBUG [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf 2023-07-22 22:07:36,175 INFO [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d599adbb1e1233229653cffd6ae12efd columnFamilyName cf 2023-07-22 22:07:36,222 DEBUG [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] regionserver.HStore(539): loaded hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/44463ff3e8e443b4a394b6b925ff412a.56b6c81bac4f0400c0088caec4d7108e->hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf/44463ff3e8e443b4a394b6b925ff412a-top 2023-07-22 22:07:36,229 DEBUG [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] regionserver.HStore(539): loaded hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/70a1319b6674491d999c2289646fe4f8.2987c42b154e4d4c3e7f974fe301ab7a->hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf/70a1319b6674491d999c2289646fe4f8-top 2023-07-22 22:07:36,230 INFO [StoreOpener-d599adbb1e1233229653cffd6ae12efd-1] regionserver.HStore(310): Store=d599adbb1e1233229653cffd6ae12efd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:36,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:36,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d599adbb1e1233229653cffd6ae12efd; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73701291, jitterRate=0.09823481738567352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:36,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d599adbb1e1233229653cffd6ae12efd: 2023-07-22 22:07:36,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd., pid=77, masterSystemTime=1690063656144 2023-07-22 22:07:36,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.,because compaction is disabled. 2023-07-22 22:07:36,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:36,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:36,241 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d599adbb1e1233229653cffd6ae12efd, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,241 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063656241"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063656241"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063656241"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063656241"}]},"ts":"1690063656241"} 2023-07-22 22:07:36,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-22 22:07:36,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure d599adbb1e1233229653cffd6ae12efd, server=jenkins-hbase4.apache.org,45315,1690063572016 in 251 msec 2023-07-22 22:07:36,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-22 22:07:36,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, ASSIGN in 416 msec 2023-07-22 22:07:36,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[56b6c81bac4f0400c0088caec4d7108e, 2987c42b154e4d4c3e7f974fe301ab7a], force=true in 891 msec 2023-07-22 22:07:36,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:36,476 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-22 22:07:36,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 22:07:36,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063656477 (current time:1690063656477). 2023-07-22 22:07:36,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:36,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x1013465c to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:36,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22792f37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:36,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:36,493 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1013465c to 127.0.0.1:62392 2023-07-22 22:07:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:36,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x0e1d6409 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:36,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b6f230, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:36,604 DEBUG [hconnection-0x6f5d6506-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:36,615 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:36,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:36,635 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e1d6409 to 127.0.0.1:62392 2023-07-22 22:07:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 22:07:36,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:36,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 22:07:36,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 22:07:36,652 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 22:07:36,655 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690064256655 2023-07-22 22:07:36,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 22:07:36,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,661 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:36,661 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:36,664 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 22:07:36,664 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:36,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 22:07:36,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 23 msec 2023-07-22 22:07:36,667 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 22:07:36,671 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690064256671 2023-07-22 22:07:36,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,728 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 22:07:36,728 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:36,730 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-22 22:07:36,730 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-22 22:07:36,741 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,741 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,743 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:36,743 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:36,743 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:36,743 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:36,744 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,744 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 22:07:36,746 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 22:07:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 22:07:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 22:07:36,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,751 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 22:07:36,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,751 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:36,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,751 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 22:07:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 22:07:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 22:07:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 22:07:36,751 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 22:07:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:36,754 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 22:07:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 22:07:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 22:07:36,758 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 22:07:36,758 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 22:07:36,758 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 22:07:36,759 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,760 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,760 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:36,762 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:36,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 22:07:36,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:36,763 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:36,765 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:36,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:36,765 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,766 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,766 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,766 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:36,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:36,766 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,767 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:36,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:36,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:36,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-22 22:07:36,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e07b01[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:36,771 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-22 22:07:36,771 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,772 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,772 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,772 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 22:07:36,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 22:07:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 22:07:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:07:36,774 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 22:07:36,774 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,774 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 22:07:36,773 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,778 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 22:07:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 22:07:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:07:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:36,779 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:36,779 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. started... 2023-07-22 22:07:36,780 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d599adbb1e1233229653cffd6ae12efd: 2023-07-22 22:07:36,781 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,781 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:36,781 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/44463ff3e8e443b4a394b6b925ff412a.56b6c81bac4f0400c0088caec4d7108e->hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf/44463ff3e8e443b4a394b6b925ff412a-top, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/70a1319b6674491d999c2289646fe4f8.2987c42b154e4d4c3e7f974fe301ab7a->hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf/70a1319b6674491d999c2289646fe4f8-top] hfiles 2023-07-22 22:07:36,781 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/44463ff3e8e443b4a394b6b925ff412a.56b6c81bac4f0400c0088caec4d7108e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,782 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/70a1319b6674491d999c2289646fe4f8.2987c42b154e4d4c3e7f974fe301ab7a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,783 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 22:07:36,783 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:36,783 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 22:07:36,811 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. completed. 2023-07-22 22:07:36,811 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 22:07:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:07:36,818 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,818 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 22:07:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:36,818 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:36,818 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 22:07:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:07:36,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-22 22:07:36,829 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-22 22:07:36,829 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:36,829 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:36,829 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,829 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:36,831 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:36,831 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,832 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:36,831 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:36,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,835 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,835 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:36,836 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,839 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,839 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,840 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,843 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,843 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:36,843 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:36,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:36,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:36,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,844 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:36,844 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:36,845 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,845 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:36,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:36,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:36,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:36,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:36,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:36,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,963 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:36,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 22:07:36,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:36,964 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:07:36,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-22 22:07:36,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,972 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:36,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690063656655Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063656844 (+189 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063656844Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063656853 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063656899 (+46 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690063656971 (+72 ms) 2023-07-22 22:07:36,976 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 22:07:36,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 315 msec 2023-07-22 22:07:37,265 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:37,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 22:07:37,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:37,267 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267 2023-07-22 22:07:37,268 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35247, tgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267, rawTgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:07:37,299 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:07:37,299 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_153104641_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:37,300 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-22 22:07:37,322 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:37,440 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,441 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,441 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,442 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,442 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,443 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,443 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,541 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-6219683354040551933.jar 2023-07-22 22:07:37,542 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,542 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,543 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,543 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,544 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:37,545 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:07:37,545 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:07:37,546 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:07:37,547 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:07:37,547 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:07:37,548 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:07:37,548 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:07:37,549 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:07:37,549 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:07:37,550 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:07:37,551 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:37,551 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:37,552 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:37,552 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:37,552 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:37,553 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:37,554 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:38,229 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:07:39,044 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:39,050 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-22 22:07:39,052 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-22 22:07:39,179 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:39,179 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:39,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:45,783 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:48,211 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:52,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:53,375 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:07:53,379 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:07:53,391 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,391 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:07:53,392 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:07:53,392 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 22:07:53,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 22:07:53,393 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,394 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 22:07:53,394 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063657267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 22:07:53,401 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:53,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063673406"}]},"ts":"1690063673406"} 2023-07-22 22:07:53,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-22 22:07:53,411 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-22 22:07:53,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, UNASSIGN}] 2023-07-22 22:07:53,414 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, UNASSIGN 2023-07-22 22:07:53,414 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d599adbb1e1233229653cffd6ae12efd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:53,414 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063673414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063673414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063673414"}]},"ts":"1690063673414"} 2023-07-22 22:07:53,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure d599adbb1e1233229653cffd6ae12efd, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:07:53,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:53,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:53,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d599adbb1e1233229653cffd6ae12efd, disabling compactions & flushes 2023-07-22 22:07:53,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:53,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:53,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. after waiting 0 ms 2023-07-22 22:07:53,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:53,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-22 22:07:53,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:53,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd. 2023-07-22 22:07:53,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d599adbb1e1233229653cffd6ae12efd: 2023-07-22 22:07:53,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:53,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d599adbb1e1233229653cffd6ae12efd, regionState=CLOSED 2023-07-22 22:07:53,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063673585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063673585"}]},"ts":"1690063673585"} 2023-07-22 22:07:53,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-22 22:07:53,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure d599adbb1e1233229653cffd6ae12efd, server=jenkins-hbase4.apache.org,45315,1690063572016 in 170 msec 2023-07-22 22:07:53,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-22 22:07:53,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d599adbb1e1233229653cffd6ae12efd, UNASSIGN in 179 msec 2023-07-22 22:07:53,594 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063673594"}]},"ts":"1690063673594"} 2023-07-22 22:07:53,596 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-22 22:07:53,599 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-22 22:07:53,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 198 msec 2023-07-22 22:07:53,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:53,709 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-22 22:07:53,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,716 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,720 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,720 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,721 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,721 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 22:07:53,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 22:07:53,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 22:07:53,722 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,722 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,722 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:53,722 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:53,722 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,723 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:53,723 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 22:07:53,723 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:53,723 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:07:53,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 22:07:53,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:53,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:53,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:53,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:53,729 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:53,729 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:53,729 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:53,734 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/recovered.edits] 2023-07-22 22:07:53,734 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/recovered.edits] 2023-07-22 22:07:53,736 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/recovered.edits] 2023-07-22 22:07:53,741 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf/70a1319b6674491d999c2289646fe4f8 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/cf/70a1319b6674491d999c2289646fe4f8 2023-07-22 22:07:53,741 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/44463ff3e8e443b4a394b6b925ff412a.56b6c81bac4f0400c0088caec4d7108e to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/44463ff3e8e443b4a394b6b925ff412a.56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:53,742 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf/44463ff3e8e443b4a394b6b925ff412a to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/cf/44463ff3e8e443b4a394b6b925ff412a 2023-07-22 22:07:53,744 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/70a1319b6674491d999c2289646fe4f8.2987c42b154e4d4c3e7f974fe301ab7a to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/cf/70a1319b6674491d999c2289646fe4f8.2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:53,747 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/recovered.edits/8.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a/recovered.edits/8.seqid 2023-07-22 22:07:53,748 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2987c42b154e4d4c3e7f974fe301ab7a 2023-07-22 22:07:53,748 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/recovered.edits/8.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e/recovered.edits/8.seqid 2023-07-22 22:07:53,749 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/56b6c81bac4f0400c0088caec4d7108e 2023-07-22 22:07:53,750 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/recovered.edits/12.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd/recovered.edits/12.seqid 2023-07-22 22:07:53,751 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d599adbb1e1233229653cffd6ae12efd 2023-07-22 22:07:53,751 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 22:07:53,754 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,756 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-22 22:07:53,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-22 22:07:53,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-22 22:07:53,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063673761"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:53,764 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-22 22:07:53,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d599adbb1e1233229653cffd6ae12efd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063654714.d599adbb1e1233229653cffd6ae12efd.', STARTKEY => '', ENDKEY => ''}] 2023-07-22 22:07:53,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-22 22:07:53,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063673764"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:53,765 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-22 22:07:53,767 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:53,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 57 msec 2023-07-22 22:07:53,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 22:07:53,825 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-22 22:07:53,826 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:53,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:53,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:53,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 22:07:53,839 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063673838"}]},"ts":"1690063673838"} 2023-07-22 22:07:53,840 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-22 22:07:53,851 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-22 22:07:53,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, UNASSIGN}] 2023-07-22 22:07:53,853 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, UNASSIGN 2023-07-22 22:07:53,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, UNASSIGN 2023-07-22 22:07:53,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f1cdee5d58f65a8c55230de53a32976e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:53,856 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063673856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063673856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063673856"}]},"ts":"1690063673856"} 2023-07-22 22:07:53,857 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=02c3802dad988aae3809d4961d7635ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:53,857 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063673857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063673857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063673857"}]},"ts":"1690063673857"} 2023-07-22 22:07:53,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure f1cdee5d58f65a8c55230de53a32976e, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:07:53,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 02c3802dad988aae3809d4961d7635ea, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:07:53,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 22:07:54,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:54,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1cdee5d58f65a8c55230de53a32976e, disabling compactions & flushes 2023-07-22 22:07:54,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:54,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:54,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. after waiting 0 ms 2023-07-22 22:07:54,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:54,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:54,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02c3802dad988aae3809d4961d7635ea, disabling compactions & flushes 2023-07-22 22:07:54,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:54,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:54,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. after waiting 0 ms 2023-07-22 22:07:54,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:54,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:54,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:54,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:54,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:54,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e. 2023-07-22 22:07:54,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea. 2023-07-22 22:07:54,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1cdee5d58f65a8c55230de53a32976e: 2023-07-22 22:07:54,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02c3802dad988aae3809d4961d7635ea: 2023-07-22 22:07:54,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:54,037 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f1cdee5d58f65a8c55230de53a32976e, regionState=CLOSED 2023-07-22 22:07:54,037 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063674037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063674037"}]},"ts":"1690063674037"} 2023-07-22 22:07:54,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:54,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=02c3802dad988aae3809d4961d7635ea, regionState=CLOSED 2023-07-22 22:07:54,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063674039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063674039"}]},"ts":"1690063674039"} 2023-07-22 22:07:54,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-22 22:07:54,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure f1cdee5d58f65a8c55230de53a32976e, server=jenkins-hbase4.apache.org,37263,1690063572153 in 178 msec 2023-07-22 22:07:54,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-22 22:07:54,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 02c3802dad988aae3809d4961d7635ea, server=jenkins-hbase4.apache.org,33875,1690063572086 in 178 msec 2023-07-22 22:07:54,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1cdee5d58f65a8c55230de53a32976e, UNASSIGN in 193 msec 2023-07-22 22:07:54,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-22 22:07:54,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02c3802dad988aae3809d4961d7635ea, UNASSIGN in 194 msec 2023-07-22 22:07:54,049 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063674048"}]},"ts":"1690063674048"} 2023-07-22 22:07:54,050 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-22 22:07:54,052 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-22 22:07:54,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 226 msec 2023-07-22 22:07:54,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 22:07:54,141 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-22 22:07:54,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,147 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,150 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,150 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,150 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:54,150 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:54,151 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:54,151 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:54,153 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,153 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/recovered.edits] 2023-07-22 22:07:54,153 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/recovered.edits] 2023-07-22 22:07:54,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:54,154 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,154 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,154 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,154 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,155 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,154 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 22:07:54,159 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf/05a9cb3834834025adb06c007dc2109c to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/cf/05a9cb3834834025adb06c007dc2109c 2023-07-22 22:07:54,159 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf/a6674b3f1c554b0d8c7759f7d6a65ccb to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/cf/a6674b3f1c554b0d8c7759f7d6a65ccb 2023-07-22 22:07:54,161 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,161 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-22 22:07:54,164 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:07:54,166 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e/recovered.edits/9.seqid 2023-07-22 22:07:54,166 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea/recovered.edits/9.seqid 2023-07-22 22:07:54,166 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1cdee5d58f65a8c55230de53a32976e 2023-07-22 22:07:54,166 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02c3802dad988aae3809d4961d7635ea 2023-07-22 22:07:54,167 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 22:07:54,167 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-22 22:07:54,168 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-22 22:07:54,172 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722b84c6578985641d9814d0be01718e7b2 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722b84c6578985641d9814d0be01718e7b2 2023-07-22 22:07:54,175 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722d3a827d6701b45d7a479cb2bd2208097 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722d3a827d6701b45d7a479cb2bd2208097 2023-07-22 22:07:54,175 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-22 22:07:54,178 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,181 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-22 22:07:54,183 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-22 22:07:54,184 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,184 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-22 22:07:54,184 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063674184"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:54,184 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063674184"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:54,186 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:07:54,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 02c3802dad988aae3809d4961d7635ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690063652853.02c3802dad988aae3809d4961d7635ea.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f1cdee5d58f65a8c55230de53a32976e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063652853.f1cdee5d58f65a8c55230de53a32976e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:07:54,186 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-22 22:07:54,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063674186"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:54,187 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-22 22:07:54,189 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 47 msec 2023-07-22 22:07:54,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 22:07:54,257 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-22 22:07:54,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 22:07:54,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,274 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 22:07:54,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:54,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-22 22:07:54,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:54,316 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 745) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343589556_1 at /127.0.0.1:56954 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4222 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35795 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:58090 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:56992 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:57194 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=629 (was 492) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=5888 (was 6106) 2023-07-22 22:07:54,316 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-22 22:07:54,338 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=629, ProcessCount=180, AvailableMemoryMB=5887 2023-07-22 22:07:54,338 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-22 22:07:54,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 22:07:54,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:07:54,344 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:07:54,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-22 22:07:54,345 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:07:54,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:54,348 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,348 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,348 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 empty. 2023-07-22 22:07:54,349 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 empty. 2023-07-22 22:07:54,349 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,349 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,349 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 22:07:54,364 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 22:07:54,365 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92c5f69ebe8267073a16ea82f128d928, NAME => 'testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:07:54,366 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 574b568dd4e6bea414c89bd35bdff475, NAME => 'testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:07:54,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:54,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 92c5f69ebe8267073a16ea82f128d928, disabling compactions & flushes 2023-07-22 22:07:54,379 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. after waiting 0 ms 2023-07-22 22:07:54,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,379 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 92c5f69ebe8267073a16ea82f128d928: 2023-07-22 22:07:54,381 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:54,381 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 574b568dd4e6bea414c89bd35bdff475, disabling compactions & flushes 2023-07-22 22:07:54,381 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,381 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,382 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. after waiting 0 ms 2023-07-22 22:07:54,382 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,382 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,382 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 574b568dd4e6bea414c89bd35bdff475: 2023-07-22 22:07:54,384 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:07:54,385 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063674385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063674385"}]},"ts":"1690063674385"} 2023-07-22 22:07:54,385 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063674385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063674385"}]},"ts":"1690063674385"} 2023-07-22 22:07:54,388 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:07:54,388 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:07:54,389 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063674389"}]},"ts":"1690063674389"} 2023-07-22 22:07:54,390 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 22:07:54,394 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:07:54,395 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:07:54,395 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:07:54,395 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:07:54,395 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:07:54,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, ASSIGN}] 2023-07-22 22:07:54,398 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, ASSIGN 2023-07-22 22:07:54,398 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, ASSIGN 2023-07-22 22:07:54,399 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33875,1690063572086; forceNewPlan=false, retain=false 2023-07-22 22:07:54,399 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45315,1690063572016; forceNewPlan=false, retain=false 2023-07-22 22:07:54,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:54,549 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:07:54,553 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=92c5f69ebe8267073a16ea82f128d928, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:54,553 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063674553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063674553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063674553"}]},"ts":"1690063674553"} 2023-07-22 22:07:54,553 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=574b568dd4e6bea414c89bd35bdff475, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:54,554 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063674553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063674553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063674553"}]},"ts":"1690063674553"} 2023-07-22 22:07:54,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 92c5f69ebe8267073a16ea82f128d928, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:07:54,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 574b568dd4e6bea414c89bd35bdff475, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:07:54,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:54,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92c5f69ebe8267073a16ea82f128d928, NAME => 'testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. service=AccessControlService 2023-07-22 22:07:54,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:54,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 574b568dd4e6bea414c89bd35bdff475, NAME => 'testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. service=AccessControlService 2023-07-22 22:07:54,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:54,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:54,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,713 INFO [StoreOpener-92c5f69ebe8267073a16ea82f128d928-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,714 DEBUG [StoreOpener-92c5f69ebe8267073a16ea82f128d928-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf 2023-07-22 22:07:54,714 DEBUG [StoreOpener-92c5f69ebe8267073a16ea82f128d928-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf 2023-07-22 22:07:54,714 INFO [StoreOpener-92c5f69ebe8267073a16ea82f128d928-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92c5f69ebe8267073a16ea82f128d928 columnFamilyName cf 2023-07-22 22:07:54,716 INFO [StoreOpener-92c5f69ebe8267073a16ea82f128d928-1] regionserver.HStore(310): Store=92c5f69ebe8267073a16ea82f128d928/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:54,717 INFO [StoreOpener-574b568dd4e6bea414c89bd35bdff475-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,718 DEBUG [StoreOpener-574b568dd4e6bea414c89bd35bdff475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf 2023-07-22 22:07:54,718 DEBUG [StoreOpener-574b568dd4e6bea414c89bd35bdff475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf 2023-07-22 22:07:54,719 INFO [StoreOpener-574b568dd4e6bea414c89bd35bdff475-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 574b568dd4e6bea414c89bd35bdff475 columnFamilyName cf 2023-07-22 22:07:54,723 INFO [StoreOpener-574b568dd4e6bea414c89bd35bdff475-1] regionserver.HStore(310): Store=574b568dd4e6bea414c89bd35bdff475/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:54,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:07:54,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:54,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92c5f69ebe8267073a16ea82f128d928; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71330422, jitterRate=0.06290611624717712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:54,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92c5f69ebe8267073a16ea82f128d928: 2023-07-22 22:07:54,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928., pid=93, masterSystemTime=1690063674707 2023-07-22 22:07:54,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:07:54,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:54,733 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=92c5f69ebe8267073a16ea82f128d928, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:54,733 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063674733"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063674733"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063674733"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063674733"}]},"ts":"1690063674733"} 2023-07-22 22:07:54,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 574b568dd4e6bea414c89bd35bdff475; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60685748, jitterRate=-0.09571188688278198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:54,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 574b568dd4e6bea414c89bd35bdff475: 2023-07-22 22:07:54,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475., pid=94, masterSystemTime=1690063674708 2023-07-22 22:07:54,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:54,736 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=574b568dd4e6bea414c89bd35bdff475, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:54,736 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063674736"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063674736"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063674736"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063674736"}]},"ts":"1690063674736"} 2023-07-22 22:07:54,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-22 22:07:54,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 92c5f69ebe8267073a16ea82f128d928, server=jenkins-hbase4.apache.org,45315,1690063572016 in 179 msec 2023-07-22 22:07:54,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, ASSIGN in 340 msec 2023-07-22 22:07:54,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-22 22:07:54,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 574b568dd4e6bea414c89bd35bdff475, server=jenkins-hbase4.apache.org,33875,1690063572086 in 182 msec 2023-07-22 22:07:54,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-22 22:07:54,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, ASSIGN in 343 msec 2023-07-22 22:07:54,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:07:54,742 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063674742"}]},"ts":"1690063674742"} 2023-07-22 22:07:54,743 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 22:07:54,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:07:54,747 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-22 22:07:54,749 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:07:54,750 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,750 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,751 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,751 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:54,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:54,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:54,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:54,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:54,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 415 msec 2023-07-22 22:07:54,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:54,951 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-22 22:07:54,954 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:54,954 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:54,956 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:54,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:54,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063674978 (current time:1690063674978). 2023-07-22 22:07:54,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:54,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x216ca62d to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:54,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51dd707b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:54,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:54,993 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:54,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x216ca62d to 127.0.0.1:62392 2023-07-22 22:07:54,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:54,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x61bbf43c to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:55,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25227be8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:55,107 DEBUG [hconnection-0x1fc6899f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:55,111 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:55,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:55,118 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:55,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61bbf43c to 127.0.0.1:62392 2023-07-22 22:07:55,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:55,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:07:55,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:55,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:55,127 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:55,128 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064275128 2023-07-22 22:07:55,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:55,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:55,129 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:55,131 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:55,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:55,133 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:55,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-22 22:07:55,138 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:55,139 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064275139 2023-07-22 22:07:55,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,159 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-22 22:07:55,159 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,160 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 22:07:55,160 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:07:55,161 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,161 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,166 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,166 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,166 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,166 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,167 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,167 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,167 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,168 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 22:07:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:55,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,171 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:55,171 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 22:07:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 22:07:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,175 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:55,175 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:55,176 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,176 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,176 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,176 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:55,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2550609[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:55,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,192 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:55,192 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:55,192 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:55,192 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:55,192 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,197 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,197 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,197 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:55,197 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,198 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,198 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:55,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2550609[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:55,202 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:07:55,202 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:55,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,204 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:55,203 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:55,203 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:55,203 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,204 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:07:55,205 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,205 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:55,206 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:55,206 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:55,206 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:55,208 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:55,208 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:55,208 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:55,208 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. started... 2023-07-22 22:07:55,208 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92c5f69ebe8267073a16ea82f128d928: 2023-07-22 22:07:55,209 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,209 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:55,209 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:55,216 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:55,216 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:55,216 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:55,216 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. started... 2023-07-22 22:07:55,218 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 574b568dd4e6bea414c89bd35bdff475: 2023-07-22 22:07:55,218 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,218 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:55,218 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:55,231 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:55,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:55,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:55,233 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:55,303 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. completed. 2023-07-22 22:07:55,303 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,310 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:55,311 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:07:55,312 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:55,312 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:55,312 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:55,312 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,316 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. completed. 2023-07-22 22:07:55,316 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:55,316 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:55,316 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:55,316 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,316 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:55,317 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:07:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,324 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,324 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,324 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:07:55,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:07:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:07:55,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:07:55,333 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 22:07:55,333 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:55,333 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:55,333 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,333 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,336 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:55,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,336 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,337 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,339 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,339 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,339 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,343 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:55,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,344 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,345 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,345 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:55,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:55,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:55,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:55,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:55,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:55,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,345 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:07:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:55,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:55,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 22:07:55,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,433 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:55,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:55,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:55,434 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:07:55,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 22:07:55,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,464 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690063675128Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690063675379 (+251 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690063675379Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690063675379Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690063675392 (+13 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690063675408 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690063675464 (+56 ms) 2023-07-22 22:07:55,468 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:55,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 337 msec 2023-07-22 22:07:55,734 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:55,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45315] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:55,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33875] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:55,741 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:55,741 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:55,741 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:55,752 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:55,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063675752 (current time:1690063675752). 2023-07-22 22:07:55,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:55,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x4c19f390 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:55,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@673801fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:55,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:55,764 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:55,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c19f390 to 127.0.0.1:62392 2023-07-22 22:07:55,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:55,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x7937b841 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:55,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a315184, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:55,791 DEBUG [hconnection-0x5d2180d6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:55,792 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:55,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:55,799 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:55,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7937b841 to 127.0.0.1:62392 2023-07-22 22:07:55,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:55,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:07:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:55,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:55,805 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:55,806 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064275806 2023-07-22 22:07:55,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:55,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:55,806 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:55,807 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:55,808 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:55,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:55,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-22 22:07:55,810 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:55,811 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064275811 2023-07-22 22:07:55,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,829 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-22 22:07:55,829 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,830 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 22:07:55,830 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:07:55,831 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,831 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,832 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,832 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,832 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,832 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:55,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:55,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:55,833 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,833 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,833 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,833 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:55,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:55,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,839 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:55,839 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:55,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:55,844 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:55,850 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:55,850 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:55,850 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:55,845 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:55,851 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:55,851 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:55,855 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,864 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,864 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:55,865 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,865 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:55,865 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,865 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f6f3d3[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:55,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:55,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:55,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f6f3d3[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:55,873 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:07:55,873 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:55,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:55,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:55,881 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:55,882 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:55,882 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:07:55,882 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:55,882 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:55,886 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:55,886 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. started... 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:55,896 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 574b568dd4e6bea414c89bd35bdff475 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-22 22:07:55,896 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:55,896 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. started... 2023-07-22 22:07:55,896 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 92c5f69ebe8267073a16ea82f128d928 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-22 22:07:55,908 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:55,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:55,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:55,909 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:55,954 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307229778f85052864fe3a42dc77a963b9745 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229778f85052864fe3a42dc77a963b9745 2023-07-22 22:07:55,955 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307222ddce0a9f8c945379b0bcc4c1435add0 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307222ddce0a9f8c945379b0bcc4c1435add0 2023-07-22 22:07:55,985 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/.tmp/cf/139df647cdef45d2a23bd0b5559e68e3 2023-07-22 22:07:55,988 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/.tmp/cf/4673be4a3fe1474095bd1477208650e1 2023-07-22 22:07:55,994 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/.tmp/cf/139df647cdef45d2a23bd0b5559e68e3 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf/139df647cdef45d2a23bd0b5559e68e3 2023-07-22 22:07:55,997 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/.tmp/cf/4673be4a3fe1474095bd1477208650e1 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf/4673be4a3fe1474095bd1477208650e1 2023-07-22 22:07:56,001 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf/139df647cdef45d2a23bd0b5559e68e3, entries=4, sequenceid=6, filesize=5.6 K 2023-07-22 22:07:56,004 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf/4673be4a3fe1474095bd1477208650e1, entries=46, sequenceid=6, filesize=12.9 K 2023-07-22 22:07:56,005 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 574b568dd4e6bea414c89bd35bdff475 in 119ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:56,005 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 22:07:56,009 INFO [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 92c5f69ebe8267073a16ea82f128d928 in 113ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:56,009 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 574b568dd4e6bea414c89bd35bdff475: 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92c5f69ebe8267073a16ea82f128d928: 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf/139df647cdef45d2a23bd0b5559e68e3] hfiles 2023-07-22 22:07:56,020 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf/139df647cdef45d2a23bd0b5559e68e3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,021 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:56,021 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf/4673be4a3fe1474095bd1477208650e1] hfiles 2023-07-22 22:07:56,021 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf/4673be4a3fe1474095bd1477208650e1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,071 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. completed. 2023-07-22 22:07:56,071 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:07:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,080 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:56,081 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:07:56,082 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:56,083 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:56,083 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:56,085 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. completed. 2023-07-22 22:07:56,085 DEBUG [rs(jenkins-hbase4.apache.org,45315,1690063572016)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:07:56,085 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:56,085 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:56,085 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,085 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:56,085 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:07:56,086 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:56,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,092 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:07:56,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:07:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:56,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:56,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:56,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45315,1690063572016': 2023-07-22 22:07:56,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:07:56,099 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 22:07:56,100 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:56,100 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:56,100 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,100 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:56,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:56,103 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:56,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:56,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,104 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,105 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:56,105 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:56,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,107 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,107 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:56,107 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,109 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:56,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:56,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:56,110 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,110 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,110 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,110 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:56,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:56,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:56,111 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,111 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:07:56,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:56,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:56,112 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:07:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:56,111 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:56,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:56,113 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:07:56,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,113 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:07:56,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:56,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:56,113 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:56,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:56,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:56,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:56,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229778f85052864fe3a42dc77a963b9745, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307222ddce0a9f8c945379b0bcc4c1435add0] mob files 2023-07-22 22:07:56,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229778f85052864fe3a42dc77a963b9745 2023-07-22 22:07:56,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307222ddce0a9f8c945379b0bcc4c1435add0 2023-07-22 22:07:56,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 22:07:56,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,258 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690063675806Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690063676138 (+332 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690063676138Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690063676138Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690063676160 (+22 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690063676199 (+39 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690063676253 (+54 ms) 2023-07-22 22:07:56,262 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:56,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 454 msec 2023-07-22 22:07:56,413 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:56,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:56,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:56,414 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414 2023-07-22 22:07:56,415 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35247, tgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414, rawTgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:07:56,458 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:07:56,458 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1830408113_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,458 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-22 22:07:56,466 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:56,949 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:56,949 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:56,950 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:56,950 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:56,950 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:56,951 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:56,951 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,027 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-2486944906924747740.jar 2023-07-22 22:07:57,028 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,028 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,028 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,029 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,029 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,029 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:57,029 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:07:57,030 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:07:57,030 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:07:57,031 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:07:57,031 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:07:57,031 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:07:57,032 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:07:57,032 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:07:57,033 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:07:57,033 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:07:57,034 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:57,034 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:57,036 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:57,036 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:57,037 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:57,037 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:57,037 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:58,246 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:58,250 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-22 22:07:58,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:58,373 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:58,373 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:58,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0006_000001 (auth:SIMPLE) 2023-07-22 22:07:59,225 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:08:05,561 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0006_000001 (auth:SIMPLE) 2023-07-22 22:08:08,719 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:08:08,723 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:08:08,734 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:08,734 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:08:08,735 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:08:08,735 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:08,736 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 22:08:08,736 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 22:08:08,736 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:08,737 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 22:08:08,737 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063676414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 22:08:08,742 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-22 22:08:08,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-22 22:08:08,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 22:08:08,748 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063688748"}]},"ts":"1690063688748"} 2023-07-22 22:08:08,749 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 22:08:08,751 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-22 22:08:08,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, UNASSIGN}] 2023-07-22 22:08:08,758 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, UNASSIGN 2023-07-22 22:08:08,758 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, UNASSIGN 2023-07-22 22:08:08,759 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=574b568dd4e6bea414c89bd35bdff475, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:08,759 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=92c5f69ebe8267073a16ea82f128d928, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:08,759 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063688758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063688758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063688758"}]},"ts":"1690063688758"} 2023-07-22 22:08:08,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063688758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063688758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063688758"}]},"ts":"1690063688758"} 2023-07-22 22:08:08,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 574b568dd4e6bea414c89bd35bdff475, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:08:08,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 92c5f69ebe8267073a16ea82f128d928, server=jenkins-hbase4.apache.org,45315,1690063572016}] 2023-07-22 22:08:08,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 22:08:08,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:08:08,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 574b568dd4e6bea414c89bd35bdff475, disabling compactions & flushes 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92c5f69ebe8267073a16ea82f128d928, disabling compactions & flushes 2023-07-22 22:08:08,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. after waiting 0 ms 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:08:08,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. after waiting 0 ms 2023-07-22 22:08:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:08:08,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:08,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:08,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:08,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928. 2023-07-22 22:08:08,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:08,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92c5f69ebe8267073a16ea82f128d928: 2023-07-22 22:08:08,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475. 2023-07-22 22:08:08,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 574b568dd4e6bea414c89bd35bdff475: 2023-07-22 22:08:08,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:08:08,962 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=92c5f69ebe8267073a16ea82f128d928, regionState=CLOSED 2023-07-22 22:08:08,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:08:08,962 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063688962"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063688962"}]},"ts":"1690063688962"} 2023-07-22 22:08:08,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=574b568dd4e6bea414c89bd35bdff475, regionState=CLOSED 2023-07-22 22:08:08,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063688966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063688966"}]},"ts":"1690063688966"} 2023-07-22 22:08:08,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-22 22:08:08,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 92c5f69ebe8267073a16ea82f128d928, server=jenkins-hbase4.apache.org,45315,1690063572016 in 206 msec 2023-07-22 22:08:08,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92c5f69ebe8267073a16ea82f128d928, UNASSIGN in 218 msec 2023-07-22 22:08:08,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-22 22:08:08,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 574b568dd4e6bea414c89bd35bdff475, server=jenkins-hbase4.apache.org,33875,1690063572086 in 209 msec 2023-07-22 22:08:08,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-22 22:08:08,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=574b568dd4e6bea414c89bd35bdff475, UNASSIGN in 219 msec 2023-07-22 22:08:08,980 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063688980"}]},"ts":"1690063688980"} 2023-07-22 22:08:08,982 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 22:08:08,984 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-22 22:08:08,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 246 msec 2023-07-22 22:08:09,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 22:08:09,050 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-22 22:08:09,051 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,055 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,056 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,057 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,061 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,061 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,061 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,061 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:09,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:09,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:09,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,063 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:09,063 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:08:09,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 22:08:09,065 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:08:09,065 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/recovered.edits] 2023-07-22 22:08:09,067 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/recovered.edits] 2023-07-22 22:08:09,082 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf/4673be4a3fe1474095bd1477208650e1 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/cf/4673be4a3fe1474095bd1477208650e1 2023-07-22 22:08:09,085 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf/139df647cdef45d2a23bd0b5559e68e3 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/cf/139df647cdef45d2a23bd0b5559e68e3 2023-07-22 22:08:09,086 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475/recovered.edits/9.seqid 2023-07-22 22:08:09,087 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/574b568dd4e6bea414c89bd35bdff475 2023-07-22 22:08:09,088 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928/recovered.edits/9.seqid 2023-07-22 22:08:09,089 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/92c5f69ebe8267073a16ea82f128d928 2023-07-22 22:08:09,089 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 22:08:09,089 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-22 22:08:09,090 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-22 22:08:09,097 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229778f85052864fe3a42dc77a963b9745 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229778f85052864fe3a42dc77a963b9745 2023-07-22 22:08:09,098 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307222ddce0a9f8c945379b0bcc4c1435add0 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307222ddce0a9f8c945379b0bcc4c1435add0 2023-07-22 22:08:09,099 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-22 22:08:09,104 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,114 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-22 22:08:09,121 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-22 22:08:09,122 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,122 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-22 22:08:09,122 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063689122"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:09,123 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063689122"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:09,129 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:08:09,129 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 92c5f69ebe8267073a16ea82f128d928, NAME => 'testtb-testEmptyExportFileSystemState,,1690063674340.92c5f69ebe8267073a16ea82f128d928.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 574b568dd4e6bea414c89bd35bdff475, NAME => 'testtb-testEmptyExportFileSystemState,1,1690063674340.574b568dd4e6bea414c89bd35bdff475.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:08:09,129 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-22 22:08:09,129 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063689129"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:09,131 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-22 22:08:09,132 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:09,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 81 msec 2023-07-22 22:08:09,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 22:08:09,166 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-22 22:08:09,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-22 22:08:09,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:09,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-22 22:08:09,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:09,208 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759 (was 758) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:37272 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_763143329_1 at /127.0.0.1:37232 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:53130 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:34365 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4904 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=907 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=750 (was 629) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=5343 (was 5887) 2023-07-22 22:08:09,208 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-22 22:08:09,233 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=750, ProcessCount=180, AvailableMemoryMB=5336 2023-07-22 22:08:09,233 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-22 22:08:09,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 22:08:09,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:09,239 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:08:09,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-22 22:08:09,240 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:08:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:09,242 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:09,242 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:09,243 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 empty. 2023-07-22 22:08:09,243 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 empty. 2023-07-22 22:08:09,243 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:09,243 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:09,243 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 22:08:09,252 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-22 22:08:09,254 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => de7efe3fd7636f4eed98cdef53ae6328, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:08:09,254 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e7a40376e35915f25af0ead8a54463b6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp 2023-07-22 22:08:09,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:09,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:09,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:09,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:09,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e7a40376e35915f25af0ead8a54463b6, disabling compactions & flushes 2023-07-22 22:08:09,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing de7efe3fd7636f4eed98cdef53ae6328, disabling compactions & flushes 2023-07-22 22:08:09,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:09,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. after waiting 0 ms 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. after waiting 0 ms 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:09,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:09,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e7a40376e35915f25af0ead8a54463b6: 2023-07-22 22:08:09,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for de7efe3fd7636f4eed98cdef53ae6328: 2023-07-22 22:08:09,671 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:08:09,672 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063689672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063689672"}]},"ts":"1690063689672"} 2023-07-22 22:08:09,673 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063689672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063689672"}]},"ts":"1690063689672"} 2023-07-22 22:08:09,675 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:08:09,675 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:08:09,676 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063689675"}]},"ts":"1690063689675"} 2023-07-22 22:08:09,677 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-22 22:08:09,681 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:08:09,683 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:08:09,683 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:08:09,683 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:08:09,683 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:08:09,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, ASSIGN}] 2023-07-22 22:08:09,686 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, ASSIGN 2023-07-22 22:08:09,686 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, ASSIGN 2023-07-22 22:08:09,686 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37263,1690063572153; forceNewPlan=false, retain=false 2023-07-22 22:08:09,686 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33875,1690063572086; forceNewPlan=false, retain=false 2023-07-22 22:08:09,837 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:08:09,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e7a40376e35915f25af0ead8a54463b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:09,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=de7efe3fd7636f4eed98cdef53ae6328, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:09,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063689840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063689840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063689840"}]},"ts":"1690063689840"} 2023-07-22 22:08:09,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063689840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063689840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063689840"}]},"ts":"1690063689840"} 2023-07-22 22:08:09,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure de7efe3fd7636f4eed98cdef53ae6328, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:08:09,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure e7a40376e35915f25af0ead8a54463b6, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:08:09,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:10,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:10,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7a40376e35915f25af0ead8a54463b6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:08:10,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. service=AccessControlService 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de7efe3fd7636f4eed98cdef53ae6328, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:08:10,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. service=AccessControlService 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:10,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:10,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,003 INFO [StoreOpener-e7a40376e35915f25af0ead8a54463b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,003 INFO [StoreOpener-de7efe3fd7636f4eed98cdef53ae6328-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,004 DEBUG [StoreOpener-e7a40376e35915f25af0ead8a54463b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf 2023-07-22 22:08:10,004 DEBUG [StoreOpener-de7efe3fd7636f4eed98cdef53ae6328-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf 2023-07-22 22:08:10,004 DEBUG [StoreOpener-de7efe3fd7636f4eed98cdef53ae6328-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf 2023-07-22 22:08:10,004 DEBUG [StoreOpener-e7a40376e35915f25af0ead8a54463b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf 2023-07-22 22:08:10,005 INFO [StoreOpener-de7efe3fd7636f4eed98cdef53ae6328-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de7efe3fd7636f4eed98cdef53ae6328 columnFamilyName cf 2023-07-22 22:08:10,005 INFO [StoreOpener-e7a40376e35915f25af0ead8a54463b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7a40376e35915f25af0ead8a54463b6 columnFamilyName cf 2023-07-22 22:08:10,006 INFO [StoreOpener-e7a40376e35915f25af0ead8a54463b6-1] regionserver.HStore(310): Store=e7a40376e35915f25af0ead8a54463b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:08:10,006 INFO [StoreOpener-de7efe3fd7636f4eed98cdef53ae6328-1] regionserver.HStore(310): Store=de7efe3fd7636f4eed98cdef53ae6328/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:08:10,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:10,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:10,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:08:10,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:08:10,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7a40376e35915f25af0ead8a54463b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64795487, jitterRate=-0.03447200357913971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:08:10,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened de7efe3fd7636f4eed98cdef53ae6328; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64860941, jitterRate=-0.033496662974357605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:08:10,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7a40376e35915f25af0ead8a54463b6: 2023-07-22 22:08:10,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for de7efe3fd7636f4eed98cdef53ae6328: 2023-07-22 22:08:10,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328., pid=108, masterSystemTime=1690063689993 2023-07-22 22:08:10,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6., pid=109, masterSystemTime=1690063689995 2023-07-22 22:08:10,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=de7efe3fd7636f4eed98cdef53ae6328, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:10,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:10,020 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063690020"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063690020"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063690020"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063690020"}]},"ts":"1690063690020"} 2023-07-22 22:08:10,022 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e7a40376e35915f25af0ead8a54463b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,022 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063690022"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063690022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063690022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063690022"}]},"ts":"1690063690022"} 2023-07-22 22:08:10,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-22 22:08:10,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure de7efe3fd7636f4eed98cdef53ae6328, server=jenkins-hbase4.apache.org,37263,1690063572153 in 181 msec 2023-07-22 22:08:10,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, ASSIGN in 340 msec 2023-07-22 22:08:10,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-22 22:08:10,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure e7a40376e35915f25af0ead8a54463b6, server=jenkins-hbase4.apache.org,33875,1690063572086 in 181 msec 2023-07-22 22:08:10,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-22 22:08:10,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, ASSIGN in 342 msec 2023-07-22 22:08:10,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:08:10,027 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063690026"}]},"ts":"1690063690026"} 2023-07-22 22:08:10,028 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-22 22:08:10,029 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:08:10,029 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-22 22:08:10,031 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 22:08:10,032 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:10,032 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:10,032 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:10,032 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:10,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:10,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:10,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:10,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:10,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 798 msec 2023-07-22 22:08:10,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:10,346 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-22 22:08:10,348 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,348 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,350 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:08:10,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:10,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063690364 (current time:1690063690364). 2023-07-22 22:08:10,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:08:10,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x198baef1 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:10,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a304d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:10,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:10,380 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:10,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x198baef1 to 127.0.0.1:62392 2023-07-22 22:08:10,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:10,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x559bf55b to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:10,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1123353f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:10,388 DEBUG [hconnection-0xb3c365d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:10,390 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:10,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:10,396 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:10,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x559bf55b to 127.0.0.1:62392 2023-07-22 22:08:10,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:10,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 22:08:10,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:08:10,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:10,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:10,400 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:10,401 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690064290401 2023-07-22 22:08:10,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:10,402 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:08:10,402 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:08:10,403 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:10,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:10,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-22 22:08:10,405 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:10,405 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690064290405 2023-07-22 22:08:10,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,414 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:10,415 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,416 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 22:08:10,416 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 22:08:10,416 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,416 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,418 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,418 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,418 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,418 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,418 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,418 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,419 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,419 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:10,422 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:10,422 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:10,422 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:10,422 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:10,422 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:10,427 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,427 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,427 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:10,428 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a51cee0[Count = 1] remaining members to acquire global barrier 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:10,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a51cee0[Count = 0] remaining members to acquire global barrier 2023-07-22 22:08:10,432 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 22:08:10,432 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:10,433 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,434 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:10,434 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. started... 2023-07-22 22:08:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,434 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:10,434 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7a40376e35915f25af0ead8a54463b6: 2023-07-22 22:08:10,434 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:08:10,434 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. started... 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de7efe3fd7636f4eed98cdef53ae6328: 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:10,436 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:08:10,439 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:10,439 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:10,439 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:10,451 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. completed. 2023-07-22 22:08:10,451 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:10,451 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:08:10,453 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. completed. 2023-07-22 22:08:10,453 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,453 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:08:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,456 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:08:10,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 22:08:10,463 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 22:08:10,463 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:08:10,463 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:08:10,463 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,463 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:10,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:10,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,465 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:10,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:10,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:10,465 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,466 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,467 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,468 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,469 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,469 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,473 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:10,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,473 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:10,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,475 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:10,475 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:10,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:10,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:10,478 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:10,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:08:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:10,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:10,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 22:08:10,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,502 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:10,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:10,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:08:10,504 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:08:10,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 22:08:10,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,551 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690063690401Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690063690491 (+90 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063690491Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063690491Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063690498 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063690511 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690063690551 (+40 ms) 2023-07-22 22:08:10,555 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:10,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 153 msec 2023-07-22 22:08:10,704 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:10,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:10,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:08:10,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37263] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:08:10,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33875] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:08:10,723 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,723 DEBUG [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:10,724 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:08:10,750 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:10,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063690750 (current time:1690063690750). 2023-07-22 22:08:10,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:08:10,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x757a1fc3 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:10,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f1e41ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:10,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:10,770 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:10,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x757a1fc3 to 127.0.0.1:62392 2023-07-22 22:08:10,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:10,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x4de38133 to 127.0.0.1:62392 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:10,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68c20b4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:10,886 DEBUG [hconnection-0x5be3e85-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:10,901 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:10,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:10,919 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:10,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4de38133 to 127.0.0.1:62392 2023-07-22 22:08:10,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:10,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 22:08:10,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:08:10,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:10,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:10,925 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:10,926 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690064290926 2023-07-22 22:08:10,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:10,928 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:08:10,928 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:08:10,929 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:10,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:10,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-22 22:08:10,937 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:10,938 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690064290938 2023-07-22 22:08:10,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,959 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:10,959 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,961 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 22:08:10,961 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 22:08:10,961 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,962 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,963 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,963 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,963 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,963 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:10,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,963 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,963 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,964 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,964 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 22:08:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 22:08:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:10,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:10,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,975 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:10,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45315,1690063572016' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:10,979 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:10,979 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:10,979 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:10,981 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,981 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,981 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:10,982 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,983 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,983 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37263,1690063572153' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@495a8ad8[Count = 1] remaining members to acquire global barrier 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:10,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:10,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:10,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:10,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33875,1690063572086' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:10,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@495a8ad8[Count = 0] remaining members to acquire global barrier 2023-07-22 22:08:10,992 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 22:08:10,992 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:10,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,000 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45315,1690063572016' in zk 2023-07-22 22:08:11,000 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. started... 2023-07-22 22:08:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:11,000 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,000 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e7a40376e35915f25af0ead8a54463b6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-22 22:08:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:11,001 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:11,001 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:11,001 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:11,001 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. started... 2023-07-22 22:08:11,001 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing de7efe3fd7636f4eed98cdef53ae6328 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-22 22:08:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,45315,1690063572016' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:11,002 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,016 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:08:11,028 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:11,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:11,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:08:11,029 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:08:11,052 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722db38cb999bc041e38d6563d918bcfbe1 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230722db38cb999bc041e38d6563d918bcfbe1 2023-07-22 22:08:11,054 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307223cac4479376142e9ba0767307e175a83 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307223cac4479376142e9ba0767307e175a83 2023-07-22 22:08:11,062 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/.tmp/cf/90977e49ecda45eaa9a16eff416cb8ff 2023-07-22 22:08:11,063 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/.tmp/cf/9136c65a25454fd59e5b2deb535131b5 2023-07-22 22:08:11,068 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/.tmp/cf/90977e49ecda45eaa9a16eff416cb8ff as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf/90977e49ecda45eaa9a16eff416cb8ff 2023-07-22 22:08:11,069 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/.tmp/cf/9136c65a25454fd59e5b2deb535131b5 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf/9136c65a25454fd59e5b2deb535131b5 2023-07-22 22:08:11,073 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf/90977e49ecda45eaa9a16eff416cb8ff, entries=48, sequenceid=6, filesize=13.5 K 2023-07-22 22:08:11,074 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf/9136c65a25454fd59e5b2deb535131b5, entries=2, sequenceid=6, filesize=5.2 K 2023-07-22 22:08:11,075 INFO [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for de7efe3fd7636f4eed98cdef53ae6328 in 74ms, sequenceid=6, compaction requested=false 2023-07-22 22:08:11,075 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:11,075 INFO [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e7a40376e35915f25af0ead8a54463b6 in 75ms, sequenceid=6, compaction requested=false 2023-07-22 22:08:11,075 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:11,080 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de7efe3fd7636f4eed98cdef53ae6328: 2023-07-22 22:08:11,082 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7a40376e35915f25af0ead8a54463b6: 2023-07-22 22:08:11,082 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,082 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,082 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:11,082 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:11,082 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf/90977e49ecda45eaa9a16eff416cb8ff] hfiles 2023-07-22 22:08:11,083 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf/9136c65a25454fd59e5b2deb535131b5] hfiles 2023-07-22 22:08:11,083 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf/90977e49ecda45eaa9a16eff416cb8ff for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,083 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf/9136c65a25454fd59e5b2deb535131b5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,107 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. completed. 2023-07-22 22:08:11,107 DEBUG [rs(jenkins-hbase4.apache.org,37263,1690063572153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:11,107 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:11,107 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:11,107 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,107 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:11,107 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37263,1690063572153' in zk 2023-07-22 22:08:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:11,109 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:11,109 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. completed. 2023-07-22 22:08:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37263,1690063572153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:11,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:11,109 DEBUG [rs(jenkins-hbase4.apache.org,33875,1690063572086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33875,1690063572086' in zk 2023-07-22 22:08:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:11,113 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,33875,1690063572086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37263,1690063572153': 2023-07-22 22:08:11,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37263,1690063572153' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 22:08:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:11,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:11,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33875,1690063572086': 2023-07-22 22:08:11,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33875,1690063572086' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 22:08:11,124 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 22:08:11,124 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:08:11,124 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:08:11,124 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,124 INFO [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:08:11,127 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:11,127 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:11,127 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,127 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,128 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:11,128 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:11,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,129 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:11,130 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:11,131 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,132 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,132 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:11,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:11,136 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,136 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,136 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,136 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,136 DEBUG [(jenkins-hbase4.apache.org,41269,1690063570541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:11,135 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:11,136 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:11,136 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,138 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:11,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:11,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:11,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:11,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307223cac4479376142e9ba0767307e175a83, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230722db38cb999bc041e38d6563d918bcfbe1] mob files 2023-07-22 22:08:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:11,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307223cac4479376142e9ba0767307e175a83 2023-07-22 22:08:11,139 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:11,139 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:11,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:11,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230722db38cb999bc041e38d6563d918bcfbe1 2023-07-22 22:08:11,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:11,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 22:08:11,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,199 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690063690926Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690063691146 (+220 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690063691146Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690063691146Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690063691155 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690063691168 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690063691199 (+31 ms) 2023-07-22 22:08:11,203 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:11,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 276 msec 2023-07-22 22:08:11,230 DEBUG [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:11,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:11,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:08:11,231 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231 2023-07-22 22:08:11,231 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35247, tgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231, rawTgtDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231, srcFsUri=hdfs://localhost:35247, srcDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:08:11,254 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8 2023-07-22 22:08:11,254 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1403742922_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,254 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35247, inputRoot=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8, snapshotDir=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-22 22:08:11,267 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:11,283 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,284 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,284 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,285 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,285 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,286 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,286 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,361 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/hadoop-3814109418369302508.jar 2023-07-22 22:08:11,361 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,362 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,362 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,362 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,363 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,363 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:11,363 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:08:11,364 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:08:11,364 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:08:11,364 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:08:11,365 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:08:11,365 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:08:11,366 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:08:11,366 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:08:11,366 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:08:11,367 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:08:11,367 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:11,367 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:11,368 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:08:11,368 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:11,369 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:11,369 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:08:11,369 DEBUG [Listener at jenkins-hbase4.apache.org/46525] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:08:12,077 WARN [Listener at jenkins-hbase4.apache.org/46525] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:08:12,079 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-22 22:08:12,081 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-22 22:08:13,023 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:08:13,023 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:08:13,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0006_000001 (auth:SIMPLE) 2023-07-22 22:08:13,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:14,601 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:08:19,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:22,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:27,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:28,363 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:08:28,363 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:08:28,397 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,397 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:08:28,398 INFO [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:08:28,398 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,398 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 22:08:28,399 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 22:08:28,399 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1467109358_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,399 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 22:08:28,399 DEBUG [Listener at jenkins-hbase4.apache.org/46525] snapshot.TestExportSnapshot(367): hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/export-test/export-1690063691231/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 22:08:28,405 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,406 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 22:08:28,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063708410"}]},"ts":"1690063708410"} 2023-07-22 22:08:28,412 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-22 22:08:28,414 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-22 22:08:28,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, UNASSIGN}] 2023-07-22 22:08:28,417 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, UNASSIGN 2023-07-22 22:08:28,417 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, UNASSIGN 2023-07-22 22:08:28,418 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=de7efe3fd7636f4eed98cdef53ae6328, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:28,418 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e7a40376e35915f25af0ead8a54463b6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:28,418 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063708418"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063708418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063708418"}]},"ts":"1690063708418"} 2023-07-22 22:08:28,418 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063708418"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063708418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063708418"}]},"ts":"1690063708418"} 2023-07-22 22:08:28,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure de7efe3fd7636f4eed98cdef53ae6328, server=jenkins-hbase4.apache.org,37263,1690063572153}] 2023-07-22 22:08:28,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure e7a40376e35915f25af0ead8a54463b6, server=jenkins-hbase4.apache.org,33875,1690063572086}] 2023-07-22 22:08:28,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 22:08:28,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:28,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing de7efe3fd7636f4eed98cdef53ae6328, disabling compactions & flushes 2023-07-22 22:08:28,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:28,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:28,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. after waiting 0 ms 2023-07-22 22:08:28,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:28,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:28,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7a40376e35915f25af0ead8a54463b6, disabling compactions & flushes 2023-07-22 22:08:28,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:28,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:28,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. after waiting 0 ms 2023-07-22 22:08:28,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:28,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:28,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:28,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:28,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:28,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328. 2023-07-22 22:08:28,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6. 2023-07-22 22:08:28,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for de7efe3fd7636f4eed98cdef53ae6328: 2023-07-22 22:08:28,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7a40376e35915f25af0ead8a54463b6: 2023-07-22 22:08:28,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:28,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=de7efe3fd7636f4eed98cdef53ae6328, regionState=CLOSED 2023-07-22 22:08:28,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:28,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063708589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063708589"}]},"ts":"1690063708589"} 2023-07-22 22:08:28,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e7a40376e35915f25af0ead8a54463b6, regionState=CLOSED 2023-07-22 22:08:28,590 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063708590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063708590"}]},"ts":"1690063708590"} 2023-07-22 22:08:28,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-22 22:08:28,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure de7efe3fd7636f4eed98cdef53ae6328, server=jenkins-hbase4.apache.org,37263,1690063572153 in 172 msec 2023-07-22 22:08:28,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-22 22:08:28,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure e7a40376e35915f25af0ead8a54463b6, server=jenkins-hbase4.apache.org,33875,1690063572086 in 172 msec 2023-07-22 22:08:28,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=de7efe3fd7636f4eed98cdef53ae6328, UNASSIGN in 178 msec 2023-07-22 22:08:28,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-22 22:08:28,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7a40376e35915f25af0ead8a54463b6, UNASSIGN in 178 msec 2023-07-22 22:08:28,595 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063708595"}]},"ts":"1690063708595"} 2023-07-22 22:08:28,596 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-22 22:08:28,597 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-22 22:08:28,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 192 msec 2023-07-22 22:08:28,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 22:08:28,714 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-22 22:08:28,715 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,728 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,729 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,732 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37263] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,737 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:28,737 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:28,738 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,738 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,738 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,738 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:28,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:28,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:28,741 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,741 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,742 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:28,742 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,741 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:28,742 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:28,742 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:28,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-22 22:08:28,742 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:08:28,743 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/recovered.edits] 2023-07-22 22:08:28,743 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf, FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/recovered.edits] 2023-07-22 22:08:28,750 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf/9136c65a25454fd59e5b2deb535131b5 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/cf/9136c65a25454fd59e5b2deb535131b5 2023-07-22 22:08:28,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 22:08:28,751 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf/90977e49ecda45eaa9a16eff416cb8ff to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/cf/90977e49ecda45eaa9a16eff416cb8ff 2023-07-22 22:08:28,754 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328/recovered.edits/9.seqid 2023-07-22 22:08:28,755 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/de7efe3fd7636f4eed98cdef53ae6328 2023-07-22 22:08:28,756 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/recovered.edits/9.seqid to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6/recovered.edits/9.seqid 2023-07-22 22:08:28,757 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7a40376e35915f25af0ead8a54463b6 2023-07-22 22:08:28,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 22:08:28,757 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-22 22:08:28,758 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-22 22:08:28,763 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307223cac4479376142e9ba0767307e175a83 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307223cac4479376142e9ba0767307e175a83 2023-07-22 22:08:28,764 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230722db38cb999bc041e38d6563d918bcfbe1 to hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230722db38cb999bc041e38d6563d918bcfbe1 2023-07-22 22:08:28,765 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-22 22:08:28,767 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,769 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-22 22:08:28,771 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-22 22:08:28,772 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,772 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-22 22:08:28,772 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063708772"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:28,772 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063708772"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:28,774 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:08:28,774 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => de7efe3fd7636f4eed98cdef53ae6328, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690063689235.de7efe3fd7636f4eed98cdef53ae6328.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e7a40376e35915f25af0ead8a54463b6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063689235.e7a40376e35915f25af0ead8a54463b6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:08:28,774 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-22 22:08:28,774 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063708774"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:28,775 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-22 22:08:28,777 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 61 msec 2023-07-22 22:08:28,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 22:08:28,852 INFO [Listener at jenkins-hbase4.apache.org/46525] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-22 22:08:28,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 22:08:28,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,864 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 22:08:28,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:28,897 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 759) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1293877002_1 at /127.0.0.1:42022 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:42038 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:39967 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:50390 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5545 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8bde54f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1467109358_17 at /127.0.0.1:53952 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=711 (was 750), ProcessCount=177 (was 180), AvailableMemoryMB=5229 (was 5336) 2023-07-22 22:08:28,897 WARN [Listener at jenkins-hbase4.apache.org/46525] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-22 22:08:28,897 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-22 22:08:28,909 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:33,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063579916_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:34,171 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:08:43,046 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:57,187 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 22:08:57,188 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:57,300 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-22 22:08:57,310 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-22 22:08:57,314 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 22:08:57,325 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:57,429 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 22:08:57,429 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-22 22:08:57,429 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 22:08:57,429 INFO [Listener at jenkins-hbase4.apache.org/46525] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 22:08:57,429 DEBUG [Listener at jenkins-hbase4.apache.org/46525] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4900eff1 to 127.0.0.1:62392 2023-07-22 22:08:57,429 DEBUG [Listener at jenkins-hbase4.apache.org/46525] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,430 DEBUG [Listener at jenkins-hbase4.apache.org/46525] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 22:08:57,430 DEBUG [Listener at jenkins-hbase4.apache.org/46525] util.JVMClusterUtil(257): Found active master hash=2045771150, stopped=false 2023-07-22 22:08:57,430 DEBUG [Listener at jenkins-hbase4.apache.org/46525] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,431 DEBUG [Listener at jenkins-hbase4.apache.org/46525] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 22:08:57,431 INFO [Listener at jenkins-hbase4.apache.org/46525] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:08:57,432 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:57,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:57,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:57,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:57,433 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:08:57,433 INFO [Listener at jenkins-hbase4.apache.org/46525] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 22:08:57,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:57,433 DEBUG [Listener at jenkins-hbase4.apache.org/46525] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32c275b9 to 127.0.0.1:62392 2023-07-22 22:08:57,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:57,433 DEBUG [Listener at jenkins-hbase4.apache.org/46525] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:57,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:57,434 INFO [Listener at jenkins-hbase4.apache.org/46525] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45315,1690063572016' ***** 2023-07-22 22:08:57,434 DEBUG [Listener at jenkins-hbase4.apache.org/46525] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,434 INFO [Listener at jenkins-hbase4.apache.org/46525] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 22:08:57,434 INFO [Listener at jenkins-hbase4.apache.org/46525] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33875,1690063572086' ***** 2023-07-22 22:08:57,434 DEBUG [Listener at jenkins-hbase4.apache.org/46525] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,434 INFO [Listener at jenkins-hbase4.apache.org/46525] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 22:08:57,434 INFO [Listener at jenkins-hbase4.apache.org/46525] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37263,1690063572153' ***** 2023-07-22 22:08:57,434 INFO [RS:0;jenkins-hbase4:45315] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 22:08:57,434 INFO [RS:1;jenkins-hbase4:33875] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 22:08:57,434 DEBUG [Listener at jenkins-hbase4.apache.org/46525] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,435 INFO [Listener at jenkins-hbase4.apache.org/46525] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 22:08:57,435 INFO [RS:2;jenkins-hbase4:37263] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 22:08:57,435 INFO [RS:1;jenkins-hbase4:33875] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 22:08:57,435 INFO [RS:0;jenkins-hbase4:45315] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 22:08:57,435 INFO [RS:0;jenkins-hbase4:45315] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 22:08:57,436 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 22:08:57,436 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(3305): Received CLOSE for b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:08:57,436 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:57,436 DEBUG [RS:0;jenkins-hbase4:45315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75ded087 to 127.0.0.1:62392 2023-07-22 22:08:57,436 DEBUG [RS:0;jenkins-hbase4:45315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b0f065e22f9b07b7b4cb4ea7e45e1834, disabling compactions & flushes 2023-07-22 22:08:57,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:08:57,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:08:57,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. after waiting 0 ms 2023-07-22 22:08:57,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:08:57,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b0f065e22f9b07b7b4cb4ea7e45e1834 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 22:08:57,435 INFO [RS:2;jenkins-hbase4:37263] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 22:08:57,441 INFO [RS:2;jenkins-hbase4:37263] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 22:08:57,441 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(3305): Received CLOSE for 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:08:57,441 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:57,441 DEBUG [RS:2;jenkins-hbase4:37263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f7f689a to 127.0.0.1:62392 2023-07-22 22:08:57,441 DEBUG [RS:2;jenkins-hbase4:37263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,440 INFO [RS:0;jenkins-hbase4:45315] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 22:08:57,435 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 22:08:57,435 INFO [RS:1;jenkins-hbase4:33875] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 22:08:57,435 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 22:08:57,442 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:57,442 DEBUG [RS:1;jenkins-hbase4:33875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x075c5045 to 127.0.0.1:62392 2023-07-22 22:08:57,441 INFO [RS:0;jenkins-hbase4:45315] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 22:08:57,442 INFO [RS:0;jenkins-hbase4:45315] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 22:08:57,442 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 22:08:57,442 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-22 22:08:57,443 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1478): Online Regions={8b59ff6cf2d83efc7ddc8899ef59e312=hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312.} 2023-07-22 22:08:57,442 DEBUG [RS:1;jenkins-hbase4:33875] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b59ff6cf2d83efc7ddc8899ef59e312, disabling compactions & flushes 2023-07-22 22:08:57,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:08:57,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:08:57,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. after waiting 0 ms 2023-07-22 22:08:57,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:08:57,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8b59ff6cf2d83efc7ddc8899ef59e312 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-22 22:08:57,443 DEBUG [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1504): Waiting on 8b59ff6cf2d83efc7ddc8899ef59e312 2023-07-22 22:08:57,444 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33875,1690063572086; all regions closed. 2023-07-22 22:08:57,444 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-22 22:08:57,444 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, b0f065e22f9b07b7b4cb4ea7e45e1834=hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834.} 2023-07-22 22:08:57,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 22:08:57,446 DEBUG [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1504): Waiting on 1588230740, b0f065e22f9b07b7b4cb4ea7e45e1834 2023-07-22 22:08:57,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 22:08:57,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 22:08:57,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 22:08:57,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 22:08:57,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-22 22:08:57,491 DEBUG [RS:1;jenkins-hbase4:33875] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs 2023-07-22 22:08:57,492 INFO [RS:1;jenkins-hbase4:33875] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33875%2C1690063572086:(num 1690063574228) 2023-07-22 22:08:57,492 DEBUG [RS:1;jenkins-hbase4:33875] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,492 INFO [RS:1;jenkins-hbase4:33875] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:57,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/.tmp/info/a6f15018669345aa9d90498c0113c0fe 2023-07-22 22:08:57,506 INFO [RS:1;jenkins-hbase4:33875] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 22:08:57,506 INFO [RS:1;jenkins-hbase4:33875] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 22:08:57,506 INFO [RS:1;jenkins-hbase4:33875] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 22:08:57,506 INFO [RS:1;jenkins-hbase4:33875] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 22:08:57,506 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:57,508 INFO [RS:1;jenkins-hbase4:33875] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33875 2023-07-22 22:08:57,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/.tmp/info/10b56a706535439cbbbd4e63903b2c61 2023-07-22 22:08:57,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/.tmp/l/5adefdd481f647eea927ca67cb54d9db 2023-07-22 22:08:57,511 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:57,518 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:57,518 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:57,518 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:57,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6f15018669345aa9d90498c0113c0fe 2023-07-22 22:08:57,518 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:57,519 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:57,518 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33875,1690063572086 2023-07-22 22:08:57,519 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:57,519 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33875,1690063572086] 2023-07-22 22:08:57,520 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:57,520 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33875,1690063572086; numProcessing=1 2023-07-22 22:08:57,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5adefdd481f647eea927ca67cb54d9db 2023-07-22 22:08:57,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/.tmp/info/10b56a706535439cbbbd4e63903b2c61 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/info/10b56a706535439cbbbd4e63903b2c61 2023-07-22 22:08:57,521 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33875,1690063572086 already deleted, retry=false 2023-07-22 22:08:57,522 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33875,1690063572086 expired; onlineServers=2 2023-07-22 22:08:57,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/.tmp/l/5adefdd481f647eea927ca67cb54d9db as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/l/5adefdd481f647eea927ca67cb54d9db 2023-07-22 22:08:57,522 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:57,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5adefdd481f647eea927ca67cb54d9db 2023-07-22 22:08:57,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/info/10b56a706535439cbbbd4e63903b2c61, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 22:08:57,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/l/5adefdd481f647eea927ca67cb54d9db, entries=7, sequenceid=18, filesize=5.2 K 2023-07-22 22:08:57,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b0f065e22f9b07b7b4cb4ea7e45e1834 in 88ms, sequenceid=6, compaction requested=false 2023-07-22 22:08:57,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8b59ff6cf2d83efc7ddc8899ef59e312 in 85ms, sequenceid=18, compaction requested=false 2023-07-22 22:08:57,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/.tmp/rep_barrier/bd16796b942142dd93f8cc4323a2583c 2023-07-22 22:08:57,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/namespace/b0f065e22f9b07b7b4cb4ea7e45e1834/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:57,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/acl/8b59ff6cf2d83efc7ddc8899ef59e312/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-22 22:08:57,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:08:57,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:08:57,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b0f065e22f9b07b7b4cb4ea7e45e1834: 2023-07-22 22:08:57,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b59ff6cf2d83efc7ddc8899ef59e312: 2023-07-22 22:08:57,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690063574875.b0f065e22f9b07b7b4cb4ea7e45e1834. 2023-07-22 22:08:57,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690063575732.8b59ff6cf2d83efc7ddc8899ef59e312. 2023-07-22 22:08:57,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd16796b942142dd93f8cc4323a2583c 2023-07-22 22:08:57,553 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/.tmp/table/ba0cc25d1dcc451caafa6107dbb71d4c 2023-07-22 22:08:57,556 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba0cc25d1dcc451caafa6107dbb71d4c 2023-07-22 22:08:57,557 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/.tmp/info/a6f15018669345aa9d90498c0113c0fe as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/info/a6f15018669345aa9d90498c0113c0fe 2023-07-22 22:08:57,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6f15018669345aa9d90498c0113c0fe 2023-07-22 22:08:57,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/info/a6f15018669345aa9d90498c0113c0fe, entries=48, sequenceid=131, filesize=10.3 K 2023-07-22 22:08:57,568 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/.tmp/rep_barrier/bd16796b942142dd93f8cc4323a2583c as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/rep_barrier/bd16796b942142dd93f8cc4323a2583c 2023-07-22 22:08:57,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd16796b942142dd93f8cc4323a2583c 2023-07-22 22:08:57,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/rep_barrier/bd16796b942142dd93f8cc4323a2583c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-22 22:08:57,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/.tmp/table/ba0cc25d1dcc451caafa6107dbb71d4c as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/table/ba0cc25d1dcc451caafa6107dbb71d4c 2023-07-22 22:08:57,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba0cc25d1dcc451caafa6107dbb71d4c 2023-07-22 22:08:57,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/table/ba0cc25d1dcc451caafa6107dbb71d4c, entries=24, sequenceid=131, filesize=6.9 K 2023-07-22 22:08:57,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 138ms, sequenceid=131, compaction requested=false 2023-07-22 22:08:57,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-22 22:08:57,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:57,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 22:08:57,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 22:08:57,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 22:08:57,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 22:08:57,621 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,621 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:33875-0x1018f1205ab0002, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,621 INFO [RS:1;jenkins-hbase4:33875] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33875,1690063572086; zookeeper connection closed. 2023-07-22 22:08:57,621 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b32873b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b32873b 2023-07-22 22:08:57,644 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37263,1690063572153; all regions closed. 2023-07-22 22:08:57,646 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45315,1690063572016; all regions closed. 2023-07-22 22:08:57,652 DEBUG [RS:2;jenkins-hbase4:37263] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs 2023-07-22 22:08:57,652 INFO [RS:2;jenkins-hbase4:37263] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37263%2C1690063572153:(num 1690063574228) 2023-07-22 22:08:57,652 DEBUG [RS:2;jenkins-hbase4:37263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,652 INFO [RS:2;jenkins-hbase4:37263] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:57,653 INFO [RS:2;jenkins-hbase4:37263] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 22:08:57,653 INFO [RS:2;jenkins-hbase4:37263] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 22:08:57,653 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:57,653 INFO [RS:2;jenkins-hbase4:37263] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 22:08:57,653 INFO [RS:2;jenkins-hbase4:37263] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 22:08:57,654 INFO [RS:2;jenkins-hbase4:37263] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37263 2023-07-22 22:08:57,655 DEBUG [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs 2023-07-22 22:08:57,655 INFO [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45315%2C1690063572016.meta:.meta(num 1690063574429) 2023-07-22 22:08:57,656 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:57,656 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:57,656 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37263,1690063572153 2023-07-22 22:08:57,656 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37263,1690063572153] 2023-07-22 22:08:57,656 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37263,1690063572153; numProcessing=2 2023-07-22 22:08:57,659 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37263,1690063572153 already deleted, retry=false 2023-07-22 22:08:57,659 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37263,1690063572153 expired; onlineServers=1 2023-07-22 22:08:57,661 DEBUG [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/oldWALs 2023-07-22 22:08:57,661 INFO [RS:0;jenkins-hbase4:45315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45315%2C1690063572016:(num 1690063574228) 2023-07-22 22:08:57,661 DEBUG [RS:0;jenkins-hbase4:45315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,661 INFO [RS:0;jenkins-hbase4:45315] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:57,661 INFO [RS:0;jenkins-hbase4:45315] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 22:08:57,661 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:57,662 INFO [RS:0;jenkins-hbase4:45315] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45315 2023-07-22 22:08:57,663 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45315,1690063572016 2023-07-22 22:08:57,663 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:57,665 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45315,1690063572016] 2023-07-22 22:08:57,665 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45315,1690063572016; numProcessing=3 2023-07-22 22:08:57,666 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45315,1690063572016 already deleted, retry=false 2023-07-22 22:08:57,666 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45315,1690063572016 expired; onlineServers=0 2023-07-22 22:08:57,666 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41269,1690063570541' ***** 2023-07-22 22:08:57,666 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 22:08:57,666 DEBUG [M:0;jenkins-hbase4:41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38d2f7b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:08:57,666 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41269,1690063570541 2023-07-22 22:08:57,666 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41269,1690063570541; all regions closed. 2023-07-22 22:08:57,666 DEBUG [M:0;jenkins-hbase4:41269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:57,666 DEBUG [M:0;jenkins-hbase4:41269] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 22:08:57,666 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 22:08:57,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690063573709] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690063573709,5,FailOnTimeoutGroup] 2023-07-22 22:08:57,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690063573711] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690063573711,5,FailOnTimeoutGroup] 2023-07-22 22:08:57,667 DEBUG [M:0;jenkins-hbase4:41269] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 22:08:57,667 INFO [M:0;jenkins-hbase4:41269] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 22:08:57,667 INFO [M:0;jenkins-hbase4:41269] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 22:08:57,667 INFO [M:0;jenkins-hbase4:41269] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-22 22:08:57,667 DEBUG [M:0;jenkins-hbase4:41269] master.HMaster(1512): Stopping service threads 2023-07-22 22:08:57,667 INFO [M:0;jenkins-hbase4:41269] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 22:08:57,667 ERROR [M:0;jenkins-hbase4:41269] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-22 22:08:57,668 INFO [M:0;jenkins-hbase4:41269] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 22:08:57,668 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 22:08:57,668 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 22:08:57,668 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:08:57,668 DEBUG [M:0;jenkins-hbase4:41269] zookeeper.ZKUtil(398): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 22:08:57,668 WARN [M:0;jenkins-hbase4:41269] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 22:08:57,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:08:57,668 INFO [M:0;jenkins-hbase4:41269] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 22:08:57,669 INFO [M:0;jenkins-hbase4:41269] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 22:08:57,669 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 22:08:57,669 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:57,669 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:57,669 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 22:08:57,669 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:57,669 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.98 KB 2023-07-22 22:08:57,685 INFO [M:0;jenkins-hbase4:41269] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f49795d2e9244a7ab8be697c173f4d90 2023-07-22 22:08:57,690 INFO [M:0;jenkins-hbase4:41269] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f49795d2e9244a7ab8be697c173f4d90 2023-07-22 22:08:57,691 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f49795d2e9244a7ab8be697c173f4d90 as hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f49795d2e9244a7ab8be697c173f4d90 2023-07-22 22:08:57,695 INFO [M:0;jenkins-hbase4:41269] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f49795d2e9244a7ab8be697c173f4d90 2023-07-22 22:08:57,695 INFO [M:0;jenkins-hbase4:41269] regionserver.HStore(1080): Added hdfs://localhost:35247/user/jenkins/test-data/5fb53c2b-86f6-b445-0087-259ba902c0e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f49795d2e9244a7ab8be697c173f4d90, entries=119, sequenceid=899, filesize=28.6 K 2023-07-22 22:08:57,696 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384667, heapSize ~451.97 KB/462816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-07-22 22:08:57,697 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:57,697 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 22:08:57,702 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:57,702 INFO [M:0;jenkins-hbase4:41269] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 22:08:57,703 INFO [M:0;jenkins-hbase4:41269] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41269 2023-07-22 22:08:57,705 DEBUG [M:0;jenkins-hbase4:41269] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41269,1690063570541 already deleted, retry=false 2023-07-22 22:08:57,757 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,757 INFO [RS:2;jenkins-hbase4:37263] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37263,1690063572153; zookeeper connection closed. 2023-07-22 22:08:57,758 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:37263-0x1018f1205ab0003, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,758 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7585bec0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7585bec0 2023-07-22 22:08:57,858 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,858 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41269,1690063570541; zookeeper connection closed. 2023-07-22 22:08:57,858 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1018f1205ab0000, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,958 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,958 INFO [RS:0;jenkins-hbase4:45315] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45315,1690063572016; zookeeper connection closed. 2023-07-22 22:08:57,958 DEBUG [Listener at localhost/36705-EventThread] zookeeper.ZKWatcher(600): regionserver:45315-0x1018f1205ab0001, quorum=127.0.0.1:62392, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:57,958 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@330c6ba4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@330c6ba4 2023-07-22 22:08:57,959 INFO [Listener at jenkins-hbase4.apache.org/46525] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-22 22:08:57,959 WARN [Listener at jenkins-hbase4.apache.org/46525] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 22:08:57,963 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:58,067 WARN [BP-337681054-172.31.14.131-1690063566419 heartbeating to localhost/127.0.0.1:35247] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 22:08:58,068 WARN [BP-337681054-172.31.14.131-1690063566419 heartbeating to localhost/127.0.0.1:35247] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337681054-172.31.14.131-1690063566419 (Datanode Uuid 0bbb2eea-585a-46ef-becb-74848c55a7c7) service to localhost/127.0.0.1:35247 2023-07-22 22:08:58,069 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data5/current/BP-337681054-172.31.14.131-1690063566419] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:58,070 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data6/current/BP-337681054-172.31.14.131-1690063566419] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:58,071 WARN [Listener at jenkins-hbase4.apache.org/46525] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 22:08:58,076 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:58,179 WARN [BP-337681054-172.31.14.131-1690063566419 heartbeating to localhost/127.0.0.1:35247] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 22:08:58,179 WARN [BP-337681054-172.31.14.131-1690063566419 heartbeating to localhost/127.0.0.1:35247] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337681054-172.31.14.131-1690063566419 (Datanode Uuid 6867b3b2-dbc8-444a-bf77-95f5c2a843cc) service to localhost/127.0.0.1:35247 2023-07-22 22:08:58,182 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data3/current/BP-337681054-172.31.14.131-1690063566419] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:58,182 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data4/current/BP-337681054-172.31.14.131-1690063566419] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:58,185 WARN [Listener at jenkins-hbase4.apache.org/46525] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 22:08:58,213 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:58,316 WARN [BP-337681054-172.31.14.131-1690063566419 heartbeating to localhost/127.0.0.1:35247] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 22:08:58,316 WARN [BP-337681054-172.31.14.131-1690063566419 heartbeating to localhost/127.0.0.1:35247] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337681054-172.31.14.131-1690063566419 (Datanode Uuid b26addf9-35fd-4b6d-826b-589a0fdba03e) service to localhost/127.0.0.1:35247 2023-07-22 22:08:58,317 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data1/current/BP-337681054-172.31.14.131-1690063566419] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:58,318 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0281cd2b-c1af-45b7-93b8-19b2e70e8a85/cluster_d929cba4-a536-3eff-e106-ac5d0e8cbef9/dfs/data/data2/current/BP-337681054-172.31.14.131-1690063566419] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:58,343 INFO [Listener at jenkins-hbase4.apache.org/46525] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:58,472 INFO [Listener at jenkins-hbase4.apache.org/46525] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 22:08:58,568 INFO [Listener at jenkins-hbase4.apache.org/46525] hbase.HBaseTestingUtility(1293): Minicluster is down