2023-09-20 09:01:04,315 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-20 09:01:04,526 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f 2023-09-20 09:01:04,526 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-20 09:01:04,526 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-20 09:01:04,568 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-20 09:01:04,829 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-20 09:01:04,830 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b, deleteOnExit=true 2023-09-20 09:01:04,830 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-20 09:01:04,831 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/test.cache.data in system properties and HBase conf 2023-09-20 09:01:04,831 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop.tmp.dir in system properties and HBase conf 2023-09-20 09:01:04,832 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop.log.dir in system properties and HBase conf 2023-09-20 09:01:04,832 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-20 09:01:04,833 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-20 09:01:04,833 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-20 09:01:05,189 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-20 09:01:05,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-20 09:01:05,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-20 09:01:05,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-20 09:01:05,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 09:01:05,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-20 09:01:05,196 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-20 09:01:05,196 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 09:01:05,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 09:01:05,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-20 09:01:05,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/nfs.dump.dir in system properties and HBase conf 2023-09-20 09:01:05,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir in system properties and HBase conf 2023-09-20 09:01:05,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 09:01:05,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-20 09:01:05,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-20 09:01:05,709 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-20 09:01:05,715 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-20 09:01:06,116 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-20 09:01:06,306 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-20 09:01:06,319 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:06,356 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:06,391 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_localhost_41353_hdfs____.6bvd9e/webapp 2023-09-20 09:01:06,536 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41353 2023-09-20 09:01:06,547 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-20 09:01:06,547 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-20 09:01:07,033 WARN [Listener at localhost/33191] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 09:01:07,110 WARN [Listener at localhost/33191] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-20 09:01:07,132 WARN [Listener at localhost/33191] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:07,178 INFO [Listener at localhost/33191] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:07,184 INFO [Listener at localhost/33191] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_localhost_42217_datanode____3sfnup/webapp 2023-09-20 09:01:07,289 INFO [Listener at localhost/33191] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42217 2023-09-20 09:01:07,760 WARN [Listener at localhost/39415] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 09:01:07,772 WARN [Listener at localhost/39415] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-20 09:01:07,777 WARN [Listener at localhost/39415] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:07,778 INFO [Listener at localhost/39415] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:07,786 INFO [Listener at localhost/39415] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_localhost_40271_datanode____.diop5/webapp 2023-09-20 09:01:07,882 INFO [Listener at localhost/39415] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40271 2023-09-20 09:01:07,891 WARN [Listener at localhost/41105] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 09:01:07,907 WARN [Listener at localhost/41105] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-20 09:01:07,910 WARN [Listener at localhost/41105] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:07,911 INFO [Listener at localhost/41105] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:07,918 INFO [Listener at localhost/41105] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_localhost_33379_datanode____922li4/webapp 2023-09-20 09:01:08,038 INFO [Listener at localhost/41105] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33379 2023-09-20 09:01:08,053 WARN [Listener at localhost/38007] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 09:01:08,358 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x675f94abc8e571f8: Processing first storage report for DS-3cdee6df-af9e-4256-af2a-10cea5f518cc from datanode a51249bd-ad0c-4eee-9bfb-ef85f06e6f8d 2023-09-20 09:01:08,360 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x675f94abc8e571f8: from storage DS-3cdee6df-af9e-4256-af2a-10cea5f518cc node DatanodeRegistration(127.0.0.1:46753, datanodeUuid=a51249bd-ad0c-4eee-9bfb-ef85f06e6f8d, infoPort=34495, infoSecurePort=0, ipcPort=41105, storageInfo=lv=-57;cid=testClusterID;nsid=118624532;c=1695200465798), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-20 09:01:08,360 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81c3e961f3a1d336: Processing first storage report for DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc from datanode 0d7ce7cc-3ade-4b9b-b3c5-982ed066fe23 2023-09-20 09:01:08,360 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81c3e961f3a1d336: from storage DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc node DatanodeRegistration(127.0.0.1:35833, datanodeUuid=0d7ce7cc-3ade-4b9b-b3c5-982ed066fe23, infoPort=46179, infoSecurePort=0, ipcPort=38007, storageInfo=lv=-57;cid=testClusterID;nsid=118624532;c=1695200465798), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xddf485c7dad601d2: Processing first storage report for DS-2051df93-adf4-4ba2-89c1-5379f0e931ee from datanode 1d16daaf-cc84-4bd1-8a99-7b03caf28eeb 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xddf485c7dad601d2: from storage DS-2051df93-adf4-4ba2-89c1-5379f0e931ee node DatanodeRegistration(127.0.0.1:44241, datanodeUuid=1d16daaf-cc84-4bd1-8a99-7b03caf28eeb, infoPort=34833, infoSecurePort=0, ipcPort=39415, storageInfo=lv=-57;cid=testClusterID;nsid=118624532;c=1695200465798), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x675f94abc8e571f8: Processing first storage report for DS-30d447b9-9618-4429-8c88-30c7a24d7457 from datanode a51249bd-ad0c-4eee-9bfb-ef85f06e6f8d 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x675f94abc8e571f8: from storage DS-30d447b9-9618-4429-8c88-30c7a24d7457 node DatanodeRegistration(127.0.0.1:46753, datanodeUuid=a51249bd-ad0c-4eee-9bfb-ef85f06e6f8d, infoPort=34495, infoSecurePort=0, ipcPort=41105, storageInfo=lv=-57;cid=testClusterID;nsid=118624532;c=1695200465798), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81c3e961f3a1d336: Processing first storage report for DS-7cfeffb3-6afd-4e33-a1de-ff29378a660d from datanode 0d7ce7cc-3ade-4b9b-b3c5-982ed066fe23 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81c3e961f3a1d336: from storage DS-7cfeffb3-6afd-4e33-a1de-ff29378a660d node DatanodeRegistration(127.0.0.1:35833, datanodeUuid=0d7ce7cc-3ade-4b9b-b3c5-982ed066fe23, infoPort=46179, infoSecurePort=0, ipcPort=38007, storageInfo=lv=-57;cid=testClusterID;nsid=118624532;c=1695200465798), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xddf485c7dad601d2: Processing first storage report for DS-c493c207-982e-4ccb-879b-9b743e45f2f8 from datanode 1d16daaf-cc84-4bd1-8a99-7b03caf28eeb 2023-09-20 09:01:08,361 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xddf485c7dad601d2: from storage DS-c493c207-982e-4ccb-879b-9b743e45f2f8 node DatanodeRegistration(127.0.0.1:44241, datanodeUuid=1d16daaf-cc84-4bd1-8a99-7b03caf28eeb, infoPort=34833, infoSecurePort=0, ipcPort=39415, storageInfo=lv=-57;cid=testClusterID;nsid=118624532;c=1695200465798), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 09:01:08,543 DEBUG [Listener at localhost/38007] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f 2023-09-20 09:01:08,631 INFO [Listener at localhost/38007] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/zookeeper_0, clientPort=51278, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-20 09:01:08,652 INFO [Listener at localhost/38007] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51278 2023-09-20 09:01:08,660 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:08,662 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:09,393 INFO [Listener at localhost/38007] util.FSUtils(471): Created version file at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 with version=8 2023-09-20 09:01:09,394 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/hbase-staging 2023-09-20 09:01:09,810 INFO [Listener at localhost/38007] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-20 09:01:10,347 INFO [Listener at localhost/38007] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 09:01:10,382 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,382 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,383 INFO [Listener at localhost/38007] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 09:01:10,383 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,383 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 09:01:10,528 INFO [Listener at localhost/38007] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 09:01:10,600 DEBUG [Listener at localhost/38007] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-20 09:01:10,694 INFO [Listener at localhost/38007] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37985 2023-09-20 09:01:10,707 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:10,709 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:10,732 INFO [Listener at localhost/38007] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37985 connecting to ZooKeeper ensemble=127.0.0.1:51278 2023-09-20 09:01:10,789 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:379850x0, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 09:01:10,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37985-0x100c89196280000 connected 2023-09-20 09:01:10,819 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 09:01:10,819 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:01:10,832 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 09:01:10,840 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37985 2023-09-20 09:01:10,840 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37985 2023-09-20 09:01:10,841 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37985 2023-09-20 09:01:10,845 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37985 2023-09-20 09:01:10,849 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37985 2023-09-20 09:01:10,855 INFO [Listener at localhost/38007] master.HMaster(444): hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, hbase.cluster.distributed=false 2023-09-20 09:01:10,916 INFO [Listener at localhost/38007] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 09:01:10,916 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,916 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,917 INFO [Listener at localhost/38007] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 09:01:10,917 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,917 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 09:01:10,921 INFO [Listener at localhost/38007] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 09:01:10,924 INFO [Listener at localhost/38007] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37597 2023-09-20 09:01:10,927 INFO [Listener at localhost/38007] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-20 09:01:10,933 INFO [Listener at localhost/38007] mob.MobFileCache(124): MobFileCache disabled 2023-09-20 09:01:10,934 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:10,936 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:10,938 INFO [Listener at localhost/38007] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37597 connecting to ZooKeeper ensemble=127.0.0.1:51278 2023-09-20 09:01:10,945 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:375970x0, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 09:01:10,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37597-0x100c89196280001 connected 2023-09-20 09:01:10,946 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 09:01:10,948 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:01:10,949 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 09:01:10,951 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37597 2023-09-20 09:01:10,951 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37597 2023-09-20 09:01:10,951 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37597 2023-09-20 09:01:10,952 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37597 2023-09-20 09:01:10,953 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37597 2023-09-20 09:01:10,965 INFO [Listener at localhost/38007] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 09:01:10,966 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,966 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,966 INFO [Listener at localhost/38007] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 09:01:10,967 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:10,967 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 09:01:10,967 INFO [Listener at localhost/38007] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 09:01:10,969 INFO [Listener at localhost/38007] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39705 2023-09-20 09:01:10,970 INFO [Listener at localhost/38007] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-20 09:01:10,972 INFO [Listener at localhost/38007] mob.MobFileCache(124): MobFileCache disabled 2023-09-20 09:01:10,973 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:10,975 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:10,977 INFO [Listener at localhost/38007] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39705 connecting to ZooKeeper ensemble=127.0.0.1:51278 2023-09-20 09:01:10,981 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:397050x0, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 09:01:10,982 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 09:01:10,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39705-0x100c89196280002 connected 2023-09-20 09:01:10,983 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:01:10,984 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 09:01:10,985 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39705 2023-09-20 09:01:10,986 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39705 2023-09-20 09:01:10,986 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39705 2023-09-20 09:01:10,989 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39705 2023-09-20 09:01:10,989 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39705 2023-09-20 09:01:11,001 INFO [Listener at localhost/38007] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 09:01:11,001 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:11,001 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:11,001 INFO [Listener at localhost/38007] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 09:01:11,001 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 09:01:11,001 INFO [Listener at localhost/38007] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 09:01:11,002 INFO [Listener at localhost/38007] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 09:01:11,003 INFO [Listener at localhost/38007] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45323 2023-09-20 09:01:11,003 INFO [Listener at localhost/38007] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-20 09:01:11,004 INFO [Listener at localhost/38007] mob.MobFileCache(124): MobFileCache disabled 2023-09-20 09:01:11,005 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:11,007 INFO [Listener at localhost/38007] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:11,009 INFO [Listener at localhost/38007] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45323 connecting to ZooKeeper ensemble=127.0.0.1:51278 2023-09-20 09:01:11,013 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:453230x0, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 09:01:11,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45323-0x100c89196280003 connected 2023-09-20 09:01:11,014 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 09:01:11,015 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:01:11,015 DEBUG [Listener at localhost/38007] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 09:01:11,017 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45323 2023-09-20 09:01:11,017 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45323 2023-09-20 09:01:11,017 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45323 2023-09-20 09:01:11,018 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45323 2023-09-20 09:01:11,021 DEBUG [Listener at localhost/38007] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45323 2023-09-20 09:01:11,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:11,032 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-20 09:01:11,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:11,053 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 09:01:11,053 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 09:01:11,053 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 09:01:11,053 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 09:01:11,054 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:11,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-20 09:01:11,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37985,1695200469633 from backup master directory 2023-09-20 09:01:11,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-20 09:01:11,061 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:11,061 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-20 09:01:11,062 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 09:01:11,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:11,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-20 09:01:11,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-20 09:01:11,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/hbase.id with ID: 45a1e358-0221-4e1a-96e5-826d776217e6 2023-09-20 09:01:11,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 09:01:11,231 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:11,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7a848ebc to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:11,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61cbfaaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:11,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-20 09:01:11,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-20 09:01:11,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-20 09:01:11,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-20 09:01:11,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-20 09:01:11,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-20 09:01:11,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 09:01:11,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store-tmp 2023-09-20 09:01:11,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:11,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-20 09:01:11,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:01:11,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:01:11,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-20 09:01:11,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:01:11,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:01:11,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-20 09:01:11,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/WALs/jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:11,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37985%2C1695200469633, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/WALs/jenkins-hbase4.apache.org,37985,1695200469633, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/oldWALs, maxLogs=10 2023-09-20 09:01:11,543 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK] 2023-09-20 09:01:11,543 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK] 2023-09-20 09:01:11,543 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK] 2023-09-20 09:01:11,552 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-20 09:01:11,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/WALs/jenkins-hbase4.apache.org,37985,1695200469633/jenkins-hbase4.apache.org%2C37985%2C1695200469633.1695200471498 2023-09-20 09:01:11,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK], DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK]] 2023-09-20 09:01:11,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-20 09:01:11,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:11,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-20 09:01:11,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-20 09:01:11,700 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-20 09:01:11,707 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-20 09:01:11,734 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-20 09:01:11,746 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:11,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-20 09:01:11,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-20 09:01:11,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-20 09:01:11,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:11,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64562398, jitterRate=-0.037945300340652466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:11,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-20 09:01:11,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-20 09:01:11,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-20 09:01:11,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-20 09:01:11,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-20 09:01:11,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-20 09:01:11,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-20 09:01:11,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-20 09:01:11,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-20 09:01:11,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-20 09:01:11,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-20 09:01:11,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-20 09:01:11,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-20 09:01:11,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-20 09:01:11,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-20 09:01:11,928 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:11,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-20 09:01:11,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-20 09:01:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-20 09:01:11,954 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 09:01:11,954 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 09:01:11,954 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:11,954 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 09:01:11,954 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 09:01:11,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37985,1695200469633, sessionid=0x100c89196280000, setting cluster-up flag (Was=false) 2023-09-20 09:01:11,976 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:11,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-20 09:01:11,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:11,991 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:11,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-20 09:01:11,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:12,002 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp 2023-09-20 09:01:12,025 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(951): ClusterId : 45a1e358-0221-4e1a-96e5-826d776217e6 2023-09-20 09:01:12,026 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(951): ClusterId : 45a1e358-0221-4e1a-96e5-826d776217e6 2023-09-20 09:01:12,025 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(951): ClusterId : 45a1e358-0221-4e1a-96e5-826d776217e6 2023-09-20 09:01:12,032 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-20 09:01:12,032 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-20 09:01:12,032 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-20 09:01:12,040 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-20 09:01:12,040 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-20 09:01:12,040 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-20 09:01:12,040 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-20 09:01:12,040 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-20 09:01:12,040 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-20 09:01:12,044 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-20 09:01:12,044 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-20 09:01:12,050 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-20 09:01:12,055 DEBUG [RS:0;jenkins-hbase4:37597] zookeeper.ReadOnlyZKClient(139): Connect 0x76486012 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:12,055 DEBUG [RS:2;jenkins-hbase4:45323] zookeeper.ReadOnlyZKClient(139): Connect 0x5b40a713 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:12,055 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ReadOnlyZKClient(139): Connect 0x244eb893 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:12,066 DEBUG [RS:2;jenkins-hbase4:45323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5587520b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:12,066 DEBUG [RS:2;jenkins-hbase4:45323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51b8cc63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 09:01:12,067 DEBUG [RS:0;jenkins-hbase4:37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788f80ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:12,067 DEBUG [RS:0;jenkins-hbase4:37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb00b62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 09:01:12,106 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a89426a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:12,106 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eb6d3e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 09:01:12,130 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37597 2023-09-20 09:01:12,130 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39705 2023-09-20 09:01:12,130 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45323 2023-09-20 09:01:12,135 INFO [RS:2;jenkins-hbase4:45323] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-20 09:01:12,135 INFO [RS:0;jenkins-hbase4:37597] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-20 09:01:12,135 INFO [RS:0;jenkins-hbase4:37597] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-20 09:01:12,135 INFO [RS:1;jenkins-hbase4:39705] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-20 09:01:12,135 INFO [RS:2;jenkins-hbase4:45323] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-20 09:01:12,136 INFO [RS:1;jenkins-hbase4:39705] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-20 09:01:12,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-20 09:01:12,148 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-20 09:01:12,148 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-20 09:01:12,148 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-20 09:01:12,150 INFO [RS:0;jenkins-hbase4:37597] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:12,150 INFO [RS:2;jenkins-hbase4:45323] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:12,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:12,150 INFO [RS:1;jenkins-hbase4:39705] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:12,150 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1022): About to register with Master. 2023-09-20 09:01:12,150 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1022): About to register with Master. 2023-09-20 09:01:12,150 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1022): About to register with Master. 2023-09-20 09:01:12,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-20 09:01:12,153 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37985,1695200469633 with isa=jenkins-hbase4.apache.org/172.31.14.131:45323, startcode=1695200471000 2023-09-20 09:01:12,153 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37985,1695200469633 with isa=jenkins-hbase4.apache.org/172.31.14.131:39705, startcode=1695200470965 2023-09-20 09:01:12,153 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37985,1695200469633 with isa=jenkins-hbase4.apache.org/172.31.14.131:37597, startcode=1695200470915 2023-09-20 09:01:12,172 DEBUG [RS:0;jenkins-hbase4:37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-20 09:01:12,172 DEBUG [RS:1;jenkins-hbase4:39705] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-20 09:01:12,172 DEBUG [RS:2;jenkins-hbase4:45323] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-20 09:01:12,227 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52803, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-20 09:01:12,228 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48517, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-20 09:01:12,227 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38039, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-20 09:01:12,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-20 09:01:12,237 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37985] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-20 09:01:12,245 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37985] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-20 09:01:12,246 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37985] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-20 09:01:12,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 09:01:12,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 09:01:12,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 09:01:12,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 09:01:12,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-20 09:01:12,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 09:01:12,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695200502251 2023-09-20 09:01:12,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-20 09:01:12,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-20 09:01:12,265 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(2830): Master is not running yet 2023-09-20 09:01:12,265 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(2830): Master is not running yet 2023-09-20 09:01:12,265 WARN [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-20 09:01:12,265 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(2830): Master is not running yet 2023-09-20 09:01:12,266 WARN [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-20 09:01:12,266 WARN [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-20 09:01:12,268 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-20 09:01:12,268 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-20 09:01:12,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-20 09:01:12,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-20 09:01:12,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-20 09:01:12,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-20 09:01:12,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-20 09:01:12,273 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-20 09:01:12,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-20 09:01:12,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-20 09:01:12,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-20 09:01:12,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-20 09:01:12,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695200472280,5,FailOnTimeoutGroup] 2023-09-20 09:01:12,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695200472280,5,FailOnTimeoutGroup] 2023-09-20 09:01:12,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-20 09:01:12,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,318 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:12,320 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:12,320 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:12,340 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:12,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-20 09:01:12,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/info 2023-09-20 09:01:12,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-20 09:01:12,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:12,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-20 09:01:12,349 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/rep_barrier 2023-09-20 09:01:12,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-20 09:01:12,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:12,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-20 09:01:12,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/table 2023-09-20 09:01:12,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-20 09:01:12,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:12,355 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740 2023-09-20 09:01:12,356 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740 2023-09-20 09:01:12,359 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-20 09:01:12,361 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-20 09:01:12,365 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:12,366 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71855978, jitterRate=0.07073751091957092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-20 09:01:12,366 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-20 09:01:12,366 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-20 09:01:12,366 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-20 09:01:12,366 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-20 09:01:12,366 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-20 09:01:12,366 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-20 09:01:12,367 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37985,1695200469633 with isa=jenkins-hbase4.apache.org/172.31.14.131:45323, startcode=1695200471000 2023-09-20 09:01:12,367 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37985,1695200469633 with isa=jenkins-hbase4.apache.org/172.31.14.131:39705, startcode=1695200470965 2023-09-20 09:01:12,367 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37985,1695200469633 with isa=jenkins-hbase4.apache.org/172.31.14.131:37597, startcode=1695200470915 2023-09-20 09:01:12,374 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-20 09:01:12,374 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-20 09:01:12,379 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37985] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,381 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-20 09:01:12,381 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-20 09:01:12,387 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37985] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,388 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:12,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37985] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,388 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33191 2023-09-20 09:01:12,388 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-20 09:01:12,388 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:12,388 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33191 2023-09-20 09:01:12,389 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-20 09:01:12,390 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:12,390 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33191 2023-09-20 09:01:12,390 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-20 09:01:12,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-20 09:01:12,401 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:01:12,403 DEBUG [RS:2;jenkins-hbase4:45323] zookeeper.ZKUtil(162): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,403 WARN [RS:2;jenkins-hbase4:45323] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 09:01:12,403 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,403 DEBUG [RS:0;jenkins-hbase4:37597] zookeeper.ZKUtil(162): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,403 INFO [RS:2;jenkins-hbase4:45323] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 09:01:12,404 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39705,1695200470965] 2023-09-20 09:01:12,403 WARN [RS:0;jenkins-hbase4:37597] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 09:01:12,403 WARN [RS:1;jenkins-hbase4:39705] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 09:01:12,404 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,405 INFO [RS:1;jenkins-hbase4:39705] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 09:01:12,404 INFO [RS:0;jenkins-hbase4:37597] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 09:01:12,406 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,406 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,404 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37597,1695200470915] 2023-09-20 09:01:12,406 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45323,1695200471000] 2023-09-20 09:01:12,421 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-20 09:01:12,425 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-20 09:01:12,427 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,427 DEBUG [RS:0;jenkins-hbase4:37597] zookeeper.ZKUtil(162): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,427 DEBUG [RS:2;jenkins-hbase4:45323] zookeeper.ZKUtil(162): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,427 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,427 DEBUG [RS:0;jenkins-hbase4:37597] zookeeper.ZKUtil(162): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,428 DEBUG [RS:2;jenkins-hbase4:45323] zookeeper.ZKUtil(162): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,428 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,428 DEBUG [RS:0;jenkins-hbase4:37597] zookeeper.ZKUtil(162): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,428 DEBUG [RS:2;jenkins-hbase4:45323] zookeeper.ZKUtil(162): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,439 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-20 09:01:12,439 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-20 09:01:12,439 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-20 09:01:12,450 INFO [RS:1;jenkins-hbase4:39705] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-20 09:01:12,450 INFO [RS:0;jenkins-hbase4:37597] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-20 09:01:12,450 INFO [RS:2;jenkins-hbase4:45323] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-20 09:01:12,471 INFO [RS:1;jenkins-hbase4:39705] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-20 09:01:12,471 INFO [RS:2;jenkins-hbase4:45323] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-20 09:01:12,473 INFO [RS:0;jenkins-hbase4:37597] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-20 09:01:12,476 INFO [RS:2;jenkins-hbase4:45323] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-20 09:01:12,476 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,477 INFO [RS:1;jenkins-hbase4:39705] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-20 09:01:12,477 INFO [RS:0;jenkins-hbase4:37597] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-20 09:01:12,478 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-20 09:01:12,478 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,478 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,478 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-20 09:01:12,478 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-20 09:01:12,486 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,486 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,486 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,486 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,487 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,487 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,487 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 09:01:12,488 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,488 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,489 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,489 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,489 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,489 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 09:01:12,489 DEBUG [RS:0;jenkins-hbase4:37597] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,489 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 09:01:12,489 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,489 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,490 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,490 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,490 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,490 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,490 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,490 DEBUG [RS:2;jenkins-hbase4:45323] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 09:01:12,492 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,493 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,493 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,494 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,495 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,495 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,501 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,501 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,501 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,516 INFO [RS:0;jenkins-hbase4:37597] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-20 09:01:12,516 INFO [RS:2;jenkins-hbase4:45323] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-20 09:01:12,516 INFO [RS:1;jenkins-hbase4:39705] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-20 09:01:12,519 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37597,1695200470915-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,519 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39705,1695200470965-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,519 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45323,1695200471000-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:12,537 INFO [RS:1;jenkins-hbase4:39705] regionserver.Replication(203): jenkins-hbase4.apache.org,39705,1695200470965 started 2023-09-20 09:01:12,538 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39705,1695200470965, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39705, sessionid=0x100c89196280002 2023-09-20 09:01:12,538 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-20 09:01:12,538 DEBUG [RS:1;jenkins-hbase4:39705] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,538 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39705,1695200470965' 2023-09-20 09:01:12,538 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-20 09:01:12,539 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-20 09:01:12,539 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-20 09:01:12,539 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-20 09:01:12,539 DEBUG [RS:1;jenkins-hbase4:39705] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:12,539 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39705,1695200470965' 2023-09-20 09:01:12,539 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:12,540 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:12,540 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-20 09:01:12,540 INFO [RS:1;jenkins-hbase4:39705] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-20 09:01:12,541 INFO [RS:1;jenkins-hbase4:39705] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-20 09:01:12,545 INFO [RS:2;jenkins-hbase4:45323] regionserver.Replication(203): jenkins-hbase4.apache.org,45323,1695200471000 started 2023-09-20 09:01:12,545 INFO [RS:0;jenkins-hbase4:37597] regionserver.Replication(203): jenkins-hbase4.apache.org,37597,1695200470915 started 2023-09-20 09:01:12,545 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45323,1695200471000, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45323, sessionid=0x100c89196280003 2023-09-20 09:01:12,545 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37597,1695200470915, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37597, sessionid=0x100c89196280001 2023-09-20 09:01:12,545 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-20 09:01:12,545 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-20 09:01:12,546 DEBUG [RS:0;jenkins-hbase4:37597] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,545 DEBUG [RS:2;jenkins-hbase4:45323] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,546 DEBUG [RS:0;jenkins-hbase4:37597] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37597,1695200470915' 2023-09-20 09:01:12,547 DEBUG [RS:0;jenkins-hbase4:37597] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-20 09:01:12,546 DEBUG [RS:2;jenkins-hbase4:45323] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45323,1695200471000' 2023-09-20 09:01:12,547 DEBUG [RS:2;jenkins-hbase4:45323] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-20 09:01:12,547 DEBUG [RS:0;jenkins-hbase4:37597] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-20 09:01:12,547 DEBUG [RS:2;jenkins-hbase4:45323] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-20 09:01:12,548 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-20 09:01:12,548 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-20 09:01:12,548 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-20 09:01:12,548 DEBUG [RS:0;jenkins-hbase4:37597] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:12,548 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-20 09:01:12,548 DEBUG [RS:0;jenkins-hbase4:37597] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37597,1695200470915' 2023-09-20 09:01:12,548 DEBUG [RS:0;jenkins-hbase4:37597] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:12,548 DEBUG [RS:2;jenkins-hbase4:45323] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,548 DEBUG [RS:2;jenkins-hbase4:45323] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45323,1695200471000' 2023-09-20 09:01:12,549 DEBUG [RS:2;jenkins-hbase4:45323] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:12,549 DEBUG [RS:0;jenkins-hbase4:37597] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:12,549 DEBUG [RS:2;jenkins-hbase4:45323] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:12,549 DEBUG [RS:0;jenkins-hbase4:37597] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-20 09:01:12,549 INFO [RS:0;jenkins-hbase4:37597] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-20 09:01:12,550 DEBUG [RS:2;jenkins-hbase4:45323] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-20 09:01:12,550 INFO [RS:0;jenkins-hbase4:37597] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-20 09:01:12,551 INFO [RS:2;jenkins-hbase4:45323] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-20 09:01:12,551 INFO [RS:2;jenkins-hbase4:45323] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-20 09:01:12,577 DEBUG [jenkins-hbase4:37985] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-20 09:01:12,581 DEBUG [jenkins-hbase4:37985] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:01:12,587 DEBUG [jenkins-hbase4:37985] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:01:12,587 DEBUG [jenkins-hbase4:37985] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:01:12,587 DEBUG [jenkins-hbase4:37985] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:01:12,587 DEBUG [jenkins-hbase4:37985] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:01:12,591 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45323,1695200471000, state=OPENING 2023-09-20 09:01:12,601 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-20 09:01:12,602 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:12,603 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-20 09:01:12,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:01:12,651 INFO [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39705%2C1695200470965, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,39705,1695200470965, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs, maxLogs=32 2023-09-20 09:01:12,654 INFO [RS:0;jenkins-hbase4:37597] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37597%2C1695200470915, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,37597,1695200470915, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs, maxLogs=32 2023-09-20 09:01:12,654 INFO [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45323%2C1695200471000, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,45323,1695200471000, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs, maxLogs=32 2023-09-20 09:01:12,674 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK] 2023-09-20 09:01:12,674 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK] 2023-09-20 09:01:12,674 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK] 2023-09-20 09:01:12,690 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK] 2023-09-20 09:01:12,690 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK] 2023-09-20 09:01:12,690 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK] 2023-09-20 09:01:12,697 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK] 2023-09-20 09:01:12,697 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK] 2023-09-20 09:01:12,699 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK] 2023-09-20 09:01:12,700 INFO [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,39705,1695200470965/jenkins-hbase4.apache.org%2C39705%2C1695200470965.1695200472654 2023-09-20 09:01:12,705 INFO [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,45323,1695200471000/jenkins-hbase4.apache.org%2C45323%2C1695200471000.1695200472656 2023-09-20 09:01:12,705 DEBUG [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK], DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK]] 2023-09-20 09:01:12,706 DEBUG [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK], DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK]] 2023-09-20 09:01:12,707 INFO [RS:0;jenkins-hbase4:37597] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,37597,1695200470915/jenkins-hbase4.apache.org%2C37597%2C1695200470915.1695200472656 2023-09-20 09:01:12,708 DEBUG [RS:0;jenkins-hbase4:37597] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK], DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK]] 2023-09-20 09:01:12,796 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:12,799 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 09:01:12,803 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 09:01:12,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-20 09:01:12,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 09:01:12,822 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45323%2C1695200471000.meta, suffix=.meta, logDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,45323,1695200471000, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs, maxLogs=32 2023-09-20 09:01:12,843 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK] 2023-09-20 09:01:12,844 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK] 2023-09-20 09:01:12,845 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK] 2023-09-20 09:01:12,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/WALs/jenkins-hbase4.apache.org,45323,1695200471000/jenkins-hbase4.apache.org%2C45323%2C1695200471000.meta.1695200472823.meta 2023-09-20 09:01:12,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44241,DS-2051df93-adf4-4ba2-89c1-5379f0e931ee,DISK], DatanodeInfoWithStorage[127.0.0.1:35833,DS-d839bb8e-c6ab-491c-bc93-5791b7b2f3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:46753,DS-3cdee6df-af9e-4256-af2a-10cea5f518cc,DISK]] 2023-09-20 09:01:12,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-20 09:01:12,855 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-20 09:01:12,856 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:12,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-20 09:01:12,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-20 09:01:12,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-20 09:01:12,874 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-20 09:01:12,874 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:12,874 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-20 09:01:12,874 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-20 09:01:12,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-20 09:01:12,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/info 2023-09-20 09:01:12,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/info 2023-09-20 09:01:12,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-20 09:01:12,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:12,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-20 09:01:12,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/rep_barrier 2023-09-20 09:01:12,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/rep_barrier 2023-09-20 09:01:12,883 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-20 09:01:12,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:12,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-20 09:01:12,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/table 2023-09-20 09:01:12,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/table 2023-09-20 09:01:12,886 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-20 09:01:12,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:12,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740 2023-09-20 09:01:12,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740 2023-09-20 09:01:12,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-20 09:01:12,897 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-20 09:01:12,898 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64792324, jitterRate=-0.03451913595199585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-20 09:01:12,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-20 09:01:12,911 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695200472788 2023-09-20 09:01:12,930 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-20 09:01:12,931 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-20 09:01:12,932 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45323,1695200471000, state=OPEN 2023-09-20 09:01:12,936 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-20 09:01:12,936 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-20 09:01:12,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-20 09:01:12,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45323,1695200471000 in 330 msec 2023-09-20 09:01:12,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-20 09:01:12,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 553 msec 2023-09-20 09:01:12,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 797 msec 2023-09-20 09:01:12,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695200472957, completionTime=-1 2023-09-20 09:01:12,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-20 09:01:12,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-20 09:01:13,020 DEBUG [hconnection-0x516761b2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:13,023 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:13,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-20 09:01:13,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695200533048 2023-09-20 09:01:13,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695200593048 2023-09-20 09:01:13,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 90 msec 2023-09-20 09:01:13,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37985,1695200469633-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:13,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37985,1695200469633-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:13,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37985,1695200469633-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:13,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37985, period=300000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:13,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-20 09:01:13,088 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-20 09:01:13,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-20 09:01:13,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-20 09:01:13,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-20 09:01:13,121 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:01:13,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:01:13,149 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,152 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985 empty. 2023-09-20 09:01:13,152 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,153 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-20 09:01:13,193 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:13,195 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a76486bae3f1aa42beaccac157f78985, NAME => 'hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:13,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:13,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a76486bae3f1aa42beaccac157f78985, disabling compactions & flushes 2023-09-20 09:01:13,214 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,215 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,215 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. after waiting 0 ms 2023-09-20 09:01:13,215 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,215 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,215 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a76486bae3f1aa42beaccac157f78985: 2023-09-20 09:01:13,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:01:13,234 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695200473222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200473222"}]},"ts":"1695200473222"} 2023-09-20 09:01:13,264 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-20 09:01:13,266 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:01:13,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200473266"}]},"ts":"1695200473266"} 2023-09-20 09:01:13,275 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-20 09:01:13,281 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:01:13,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:01:13,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:01:13,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:01:13,283 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:01:13,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a76486bae3f1aa42beaccac157f78985, ASSIGN}] 2023-09-20 09:01:13,290 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a76486bae3f1aa42beaccac157f78985, ASSIGN 2023-09-20 09:01:13,292 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a76486bae3f1aa42beaccac157f78985, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45323,1695200471000; forceNewPlan=false, retain=false 2023-09-20 09:01:13,445 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-20 09:01:13,447 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a76486bae3f1aa42beaccac157f78985, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:13,448 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695200473446"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200473446"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200473446"}]},"ts":"1695200473446"} 2023-09-20 09:01:13,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a76486bae3f1aa42beaccac157f78985, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:01:13,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a76486bae3f1aa42beaccac157f78985, NAME => 'hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.', STARTKEY => '', ENDKEY => ''} 2023-09-20 09:01:13,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. service=AccessControlService 2023-09-20 09:01:13,615 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:13,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:13,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,618 INFO [StoreOpener-a76486bae3f1aa42beaccac157f78985-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,621 DEBUG [StoreOpener-a76486bae3f1aa42beaccac157f78985-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/info 2023-09-20 09:01:13,621 DEBUG [StoreOpener-a76486bae3f1aa42beaccac157f78985-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/info 2023-09-20 09:01:13,621 INFO [StoreOpener-a76486bae3f1aa42beaccac157f78985-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a76486bae3f1aa42beaccac157f78985 columnFamilyName info 2023-09-20 09:01:13,622 INFO [StoreOpener-a76486bae3f1aa42beaccac157f78985-1] regionserver.HStore(310): Store=a76486bae3f1aa42beaccac157f78985/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:13,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,628 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a76486bae3f1aa42beaccac157f78985 2023-09-20 09:01:13,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:13,633 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a76486bae3f1aa42beaccac157f78985; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73356960, jitterRate=0.09310388565063477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:13,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a76486bae3f1aa42beaccac157f78985: 2023-09-20 09:01:13,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985., pid=6, masterSystemTime=1695200473606 2023-09-20 09:01:13,639 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,639 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:01:13,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a76486bae3f1aa42beaccac157f78985, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:13,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695200473640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200473640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200473640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200473640"}]},"ts":"1695200473640"} 2023-09-20 09:01:13,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-20 09:01:13,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a76486bae3f1aa42beaccac157f78985, server=jenkins-hbase4.apache.org,45323,1695200471000 in 192 msec 2023-09-20 09:01:13,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-20 09:01:13,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a76486bae3f1aa42beaccac157f78985, ASSIGN in 361 msec 2023-09-20 09:01:13,654 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:01:13,654 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200473654"}]},"ts":"1695200473654"} 2023-09-20 09:01:13,656 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-20 09:01:13,660 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:01:13,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 554 msec 2023-09-20 09:01:13,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-20 09:01:13,723 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-20 09:01:13,723 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:13,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-20 09:01:13,774 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-20 09:01:13,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-09-20 09:01:13,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-20 09:01:13,804 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-20 09:01:13,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-20 09:01:13,819 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-20 09:01:13,822 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-20 09:01:13,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.761sec 2023-09-20 09:01:13,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-20 09:01:13,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-20 09:01:13,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-20 09:01:13,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37985,1695200469633-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-20 09:01:13,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37985,1695200469633-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-20 09:01:13,834 DEBUG [Listener at localhost/38007] zookeeper.ReadOnlyZKClient(139): Connect 0x06f7fee9 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:13,843 DEBUG [Listener at localhost/38007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21c22958, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:13,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-20 09:01:13,858 DEBUG [hconnection-0x1a7f3ba8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:13,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-20 09:01:13,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:01:13,863 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:01:13,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-20 09:01:13,866 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:13,867 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057 empty. 2023-09-20 09:01:13,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:13,870 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-20 09:01:13,874 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:13,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/test.cache.data in system properties and HBase conf 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop.tmp.dir in system properties and HBase conf 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop.log.dir in system properties and HBase conf 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-20 09:01:13,878 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-20 09:01:13,879 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-20 09:01:13,880 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 09:01:13,880 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 09:01:13,880 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-20 09:01:13,881 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/nfs.dump.dir in system properties and HBase conf 2023-09-20 09:01:13,881 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir in system properties and HBase conf 2023-09-20 09:01:13,881 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 09:01:13,881 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-20 09:01:13,881 INFO [Listener at localhost/38007] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-20 09:01:13,897 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:13,900 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7eb12788278f5398ff0ae9615dc85057, NAME => 'hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:13,922 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:13,923 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 7eb12788278f5398ff0ae9615dc85057, disabling compactions & flushes 2023-09-20 09:01:13,923 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:13,923 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:13,923 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. after waiting 0 ms 2023-09-20 09:01:13,923 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:13,923 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:13,923 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 7eb12788278f5398ff0ae9615dc85057: 2023-09-20 09:01:13,928 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:01:13,943 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695200473942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200473942"}]},"ts":"1695200473942"} 2023-09-20 09:01:13,947 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-20 09:01:13,950 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:01:13,950 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200473950"}]},"ts":"1695200473950"} 2023-09-20 09:01:13,953 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-20 09:01:13,960 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:01:13,962 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:01:13,963 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:01:13,963 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:01:13,963 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:01:13,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7eb12788278f5398ff0ae9615dc85057, ASSIGN}] 2023-09-20 09:01:13,966 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7eb12788278f5398ff0ae9615dc85057, ASSIGN 2023-09-20 09:01:13,968 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=7eb12788278f5398ff0ae9615dc85057, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:01:13,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 09:01:14,119 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-20 09:01:14,120 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7eb12788278f5398ff0ae9615dc85057, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:14,120 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695200474120"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200474120"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200474120"}]},"ts":"1695200474120"} 2023-09-20 09:01:14,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7eb12788278f5398ff0ae9615dc85057, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:01:14,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 09:01:14,278 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:14,279 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 09:01:14,282 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 09:01:14,289 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:14,289 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eb12788278f5398ff0ae9615dc85057, NAME => 'hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.', STARTKEY => '', ENDKEY => ''} 2023-09-20 09:01:14,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. service=AccessControlService 2023-09-20 09:01:14,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:14,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:14,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,295 INFO [StoreOpener-7eb12788278f5398ff0ae9615dc85057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,298 DEBUG [StoreOpener-7eb12788278f5398ff0ae9615dc85057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/l 2023-09-20 09:01:14,298 DEBUG [StoreOpener-7eb12788278f5398ff0ae9615dc85057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/l 2023-09-20 09:01:14,298 INFO [StoreOpener-7eb12788278f5398ff0ae9615dc85057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eb12788278f5398ff0ae9615dc85057 columnFamilyName l 2023-09-20 09:01:14,299 INFO [StoreOpener-7eb12788278f5398ff0ae9615dc85057-1] regionserver.HStore(310): Store=7eb12788278f5398ff0ae9615dc85057/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:14,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,307 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:01:14,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:14,312 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7eb12788278f5398ff0ae9615dc85057; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64408778, jitterRate=-0.04023441672325134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:14,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7eb12788278f5398ff0ae9615dc85057: 2023-09-20 09:01:14,316 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057., pid=11, masterSystemTime=1695200474278 2023-09-20 09:01:14,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:14,320 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:01:14,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7eb12788278f5398ff0ae9615dc85057, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:14,322 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695200474321"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200474321"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200474321"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200474321"}]},"ts":"1695200474321"} 2023-09-20 09:01:14,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-20 09:01:14,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7eb12788278f5398ff0ae9615dc85057, server=jenkins-hbase4.apache.org,37597,1695200470915 in 200 msec 2023-09-20 09:01:14,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-20 09:01:14,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=7eb12788278f5398ff0ae9615dc85057, ASSIGN in 365 msec 2023-09-20 09:01:14,333 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:01:14,333 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200474333"}]},"ts":"1695200474333"} 2023-09-20 09:01:14,336 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-20 09:01:14,340 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:01:14,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 484 msec 2023-09-20 09:01:14,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 09:01:14,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-20 09:01:14,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-20 09:01:15,159 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:15,544 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:15,550 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38997_jobhistory____mbxx6j/webapp 2023-09-20 09:01:15,725 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-20 09:01:15,725 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-20 09:01:15,725 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 09:01:15,728 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 09:01:15,812 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:16,144 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:16,404 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-20 09:01:16,432 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38997 2023-09-20 09:01:16,654 WARN [Listener at jenkins-hbase4.apache.org/33567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:16,961 WARN [Listener at jenkins-hbase4.apache.org/33567] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-20 09:01:16,962 INFO [Listener at jenkins-hbase4.apache.org/33567] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:16,968 INFO [Listener at jenkins-hbase4.apache.org/33567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37467_cluster____v5zj77/webapp 2023-09-20 09:01:17,041 INFO [Listener at jenkins-hbase4.apache.org/33567] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-20 09:01:17,041 INFO [Listener at jenkins-hbase4.apache.org/33567] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-20 09:01:17,041 INFO [Listener at jenkins-hbase4.apache.org/33567] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 09:01:17,042 INFO [Listener at jenkins-hbase4.apache.org/33567] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 09:01:17,050 INFO [Listener at jenkins-hbase4.apache.org/33567] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:17,226 INFO [Listener at jenkins-hbase4.apache.org/33567] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:17,324 INFO [Listener at jenkins-hbase4.apache.org/33567] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:17,336 INFO [Listener at jenkins-hbase4.apache.org/33567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37467 2023-09-20 09:01:17,801 WARN [Listener at jenkins-hbase4.apache.org/43343] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:17,826 WARN [Listener at jenkins-hbase4.apache.org/43343] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-20 09:01:17,827 INFO [Listener at jenkins-hbase4.apache.org/43343] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:17,834 INFO [Listener at jenkins-hbase4.apache.org/43343] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45921_node____.x8rfl7/webapp 2023-09-20 09:01:17,902 INFO [Listener at jenkins-hbase4.apache.org/43343] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-20 09:01:17,902 INFO [Listener at jenkins-hbase4.apache.org/43343] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 09:01:17,903 INFO [Listener at jenkins-hbase4.apache.org/43343] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-20 09:01:17,903 INFO [Listener at jenkins-hbase4.apache.org/43343] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 09:01:17,929 INFO [Listener at jenkins-hbase4.apache.org/43343] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:17,949 INFO [Listener at jenkins-hbase4.apache.org/43343] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:18,009 INFO [Listener at jenkins-hbase4.apache.org/43343] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:18,019 INFO [Listener at jenkins-hbase4.apache.org/43343] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45921 2023-09-20 09:01:18,185 WARN [Listener at jenkins-hbase4.apache.org/32943] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 09:01:18,194 WARN [Listener at jenkins-hbase4.apache.org/32943] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-20 09:01:18,194 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 09:01:18,204 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33321_node____3l5574/webapp 2023-09-20 09:01:18,263 INFO [Listener at jenkins-hbase4.apache.org/32943] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-20 09:01:18,263 INFO [Listener at jenkins-hbase4.apache.org/32943] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 09:01:18,263 INFO [Listener at jenkins-hbase4.apache.org/32943] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-20 09:01:18,264 INFO [Listener at jenkins-hbase4.apache.org/32943] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 09:01:18,273 INFO [Listener at jenkins-hbase4.apache.org/32943] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:18,287 INFO [Listener at jenkins-hbase4.apache.org/32943] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:18,348 INFO [Listener at jenkins-hbase4.apache.org/32943] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 09:01:18,353 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33321 2023-09-20 09:01:18,377 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-20 09:01:18,379 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:18,441 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:01:18,457 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=165, AvailableMemoryMB=12697 2023-09-20 09:01:18,457 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-20 09:01:18,498 DEBUG [Listener at jenkins-hbase4.apache.org/32943] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-20 09:01:18,504 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-20 09:01:18,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 09:01:18,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:18,521 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:01:18,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-20 09:01:18,526 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:01:18,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 09:01:18,535 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc 2023-09-20 09:01:18,539 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc empty. 2023-09-20 09:01:18,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:18,541 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc 2023-09-20 09:01:18,541 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 empty. 2023-09-20 09:01:18,544 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:18,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-20 09:01:18,589 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:18,594 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 533db2630cabe82575f66716505deadc, NAME => 'testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:18,594 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e587bcd7eb4da719b55a1f259ae54600, NAME => 'testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:18,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 09:01:18,659 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:18,661 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:18,661 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e587bcd7eb4da719b55a1f259ae54600, disabling compactions & flushes 2023-09-20 09:01:18,661 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 533db2630cabe82575f66716505deadc, disabling compactions & flushes 2023-09-20 09:01:18,661 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:18,661 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:18,661 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. after waiting 0 ms 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. after waiting 0 ms 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:18,662 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:18,662 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e587bcd7eb4da719b55a1f259ae54600: 2023-09-20 09:01:18,662 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 533db2630cabe82575f66716505deadc: 2023-09-20 09:01:18,670 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:01:18,672 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200478672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200478672"}]},"ts":"1695200478672"} 2023-09-20 09:01:18,672 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200478672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200478672"}]},"ts":"1695200478672"} 2023-09-20 09:01:18,673 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-20 09:01:18,674 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-20 09:01:18,675 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-20 09:01:18,723 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:01:18,725 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:01:18,725 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200478725"}]},"ts":"1695200478725"} 2023-09-20 09:01:18,727 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-20 09:01:18,733 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:01:18,735 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:01:18,735 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:01:18,735 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:01:18,735 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:01:18,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, ASSIGN}] 2023-09-20 09:01:18,739 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, ASSIGN 2023-09-20 09:01:18,739 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, ASSIGN 2023-09-20 09:01:18,740 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39705,1695200470965; forceNewPlan=false, retain=false 2023-09-20 09:01:18,740 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:01:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 09:01:18,890 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:01:18,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=533db2630cabe82575f66716505deadc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:18,893 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e587bcd7eb4da719b55a1f259ae54600, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:18,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200478893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200478893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200478893"}]},"ts":"1695200478893"} 2023-09-20 09:01:18,893 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200478893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200478893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200478893"}]},"ts":"1695200478893"} 2023-09-20 09:01:18,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 533db2630cabe82575f66716505deadc, server=jenkins-hbase4.apache.org,39705,1695200470965}] 2023-09-20 09:01:18,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure e587bcd7eb4da719b55a1f259ae54600, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:01:19,050 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,050 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 09:01:19,054 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 09:01:19,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:19,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e587bcd7eb4da719b55a1f259ae54600, NAME => 'testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 09:01:19,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 533db2630cabe82575f66716505deadc, NAME => 'testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. service=AccessControlService 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. service=AccessControlService 2023-09-20 09:01:19,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:19,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,066 INFO [StoreOpener-533db2630cabe82575f66716505deadc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,067 INFO [StoreOpener-e587bcd7eb4da719b55a1f259ae54600-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,068 DEBUG [StoreOpener-533db2630cabe82575f66716505deadc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf 2023-09-20 09:01:19,068 DEBUG [StoreOpener-533db2630cabe82575f66716505deadc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf 2023-09-20 09:01:19,068 DEBUG [StoreOpener-e587bcd7eb4da719b55a1f259ae54600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf 2023-09-20 09:01:19,068 DEBUG [StoreOpener-e587bcd7eb4da719b55a1f259ae54600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf 2023-09-20 09:01:19,072 INFO [StoreOpener-e587bcd7eb4da719b55a1f259ae54600-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e587bcd7eb4da719b55a1f259ae54600 columnFamilyName cf 2023-09-20 09:01:19,072 INFO [StoreOpener-533db2630cabe82575f66716505deadc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 533db2630cabe82575f66716505deadc columnFamilyName cf 2023-09-20 09:01:19,075 INFO [StoreOpener-533db2630cabe82575f66716505deadc-1] regionserver.HStore(310): Store=533db2630cabe82575f66716505deadc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:19,075 INFO [StoreOpener-e587bcd7eb4da719b55a1f259ae54600-1] regionserver.HStore(310): Store=e587bcd7eb4da719b55a1f259ae54600/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:19,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:19,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 533db2630cabe82575f66716505deadc 2023-09-20 09:01:19,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:19,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:19,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e587bcd7eb4da719b55a1f259ae54600; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66038942, jitterRate=-0.015943080186843872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:19,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e587bcd7eb4da719b55a1f259ae54600: 2023-09-20 09:01:19,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 533db2630cabe82575f66716505deadc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70461263, jitterRate=0.04995463788509369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:19,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 533db2630cabe82575f66716505deadc: 2023-09-20 09:01:19,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600., pid=16, masterSystemTime=1695200479050 2023-09-20 09:01:19,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc., pid=15, masterSystemTime=1695200479050 2023-09-20 09:01:19,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:19,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:19,103 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e587bcd7eb4da719b55a1f259ae54600, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:19,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:19,105 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200479103"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200479103"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200479103"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200479103"}]},"ts":"1695200479103"} 2023-09-20 09:01:19,106 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=533db2630cabe82575f66716505deadc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200479105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200479105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200479105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200479105"}]},"ts":"1695200479105"} 2023-09-20 09:01:19,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-20 09:01:19,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure e587bcd7eb4da719b55a1f259ae54600, server=jenkins-hbase4.apache.org,37597,1695200470915 in 210 msec 2023-09-20 09:01:19,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-20 09:01:19,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 533db2630cabe82575f66716505deadc, server=jenkins-hbase4.apache.org,39705,1695200470965 in 213 msec 2023-09-20 09:01:19,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, ASSIGN in 376 msec 2023-09-20 09:01:19,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-20 09:01:19,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, ASSIGN in 378 msec 2023-09-20 09:01:19,119 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:01:19,119 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200479119"}]},"ts":"1695200479119"} 2023-09-20 09:01:19,122 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-20 09:01:19,125 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:01:19,130 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-20 09:01:19,135 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,139 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,143 DEBUG [hconnection-0x1ad41739-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,147 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,158 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-20 09:01:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 09:01:19,201 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:19,201 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:19,201 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:19,201 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:19,201 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:01:19,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:19,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:19,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:19,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:19,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 696 msec 2023-09-20 09:01:19,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 09:01:19,662 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-20 09:01:19,667 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-20 09:01:19,668 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:19,670 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:19,693 DEBUG [hconnection-0x1a7f3ba8-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,699 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,702 DEBUG [hconnection-0x1a7f3ba8-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 09:01:19,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200479718 (current time:1695200479718). 2023-09-20 09:01:19,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:01:19,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x123faec1 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:19,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7540a306, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:19,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,728 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x123faec1 to 127.0.0.1:51278 2023-09-20 09:01:19,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x7e11ae85 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:19,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36a70616, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:19,742 DEBUG [hconnection-0x2b19acce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,745 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:19,751 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:19,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e11ae85 to 127.0.0.1:51278 2023-09-20 09:01:19,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:19,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-20 09:01:19,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:01:19,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 09:01:19,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 09:01:19,801 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 09:01:19,803 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695201079803 2023-09-20 09:01:19,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 09:01:19,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-20 09:01:19,806 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 09:01:19,807 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:19,808 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-20 09:01:19,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 09:01:19,808 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:19,808 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-20 09:01:19,808 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-20 09:01:19,809 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-20 09:01:19,809 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:19,809 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-20 09:01:19,809 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-20 09:01:19,809 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-20 09:01:19,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-20 09:01:19,811 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 09:01:19,812 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:01:19,813 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695201079813 2023-09-20 09:01:19,813 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:01:19,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,847 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-20 09:01:19,847 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:19,847 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-20 09:01:19,848 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-20 09:01:19,848 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,849 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,854 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:19,854 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:19,854 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:19,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:19,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:19,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:19,854 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:19,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:19,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:19,855 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,855 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,856 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,856 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-20 09:01:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-20 09:01:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 09:01:19,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 09:01:19,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 09:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 09:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 09:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 09:01:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 09:01:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-20 09:01:19,867 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-20 09:01:19,870 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:19,871 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:19,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-20 09:01:19,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a306b2e[Count = 1] remaining members to acquire global barrier 2023-09-20 09:01:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:19,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-20 09:01:19,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a306b2e[Count = 0] remaining members to acquire global barrier 2023-09-20 09:01:19,882 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-20 09:01:19,883 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,886 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 09:01:19,886 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 09:01:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-20 09:01:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 09:01:19,887 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,887 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:01:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:01:19,888 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:19,888 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:19,888 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:19,888 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:19,888 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:19,888 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:19,888 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. started... 2023-09-20 09:01:19,888 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. started... 2023-09-20 09:01:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 09:01:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-20 09:01:19,893 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e587bcd7eb4da719b55a1f259ae54600: 2023-09-20 09:01:19,893 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 533db2630cabe82575f66716505deadc: 2023-09-20 09:01:19,894 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,894 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,899 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:19,899 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:19,903 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:01:19,903 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:01:19,913 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:19,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 09:01:19,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:19,918 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:01:19,935 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. completed. 2023-09-20 09:01:19,936 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,937 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-20 09:01:19,937 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:01:19,938 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. completed. 2023-09-20 09:01:19,938 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:19,939 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:19,939 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:19,939 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,939 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-20 09:01:19,939 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:01:19,940 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 09:01:19,940 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,940 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:19,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,940 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-20 09:01:19,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:19,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:19,942 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 09:01:19,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:19,942 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:19,942 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,942 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-20 09:01:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:01:19,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-20 09:01:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:19,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:19,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39705,1695200470965': 2023-09-20 09:01:19,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-20 09:01:19,954 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-20 09:01:19,954 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:01:19,954 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:01:19,954 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,954 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:19,958 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,959 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:19,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:19,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:19,959 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,960 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:19,962 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,963 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,963 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:19,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:19,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:19,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:19,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:19,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:19,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:19,979 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:19,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:19,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:19,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:19,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-20 09:01:19,980 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:19,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:19,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:01:19,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:19,980 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:19,981 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,981 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:19,981 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:19,981 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,981 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:19,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 09:01:19,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:20,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:20,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:20,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-20 09:01:20,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:20,052 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:20,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695200479803Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695200479997 (+194 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695200479998 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695200479998Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695200480012 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695200480038 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695200480051 (+13 ms) 2023-09-20 09:01:20,054 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 09:01:20,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 249 msec 2023-09-20 09:01:20,118 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:20,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 09:01:20,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:01:20,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39705] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:01:20,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:01:20,145 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-20 09:01:20,146 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:20,146 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:20,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 09:01:20,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200480161 (current time:1695200480161). 2023-09-20 09:01:20,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:01:20,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x7d6843f9 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:20,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ec407a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:20,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:20,173 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d6843f9 to 127.0.0.1:51278 2023-09-20 09:01:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:20,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x6772b380 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:20,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58ba431c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:20,185 DEBUG [hconnection-0x362dbeb7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:20,187 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:20,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:20,193 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:20,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6772b380 to 127.0.0.1:51278 2023-09-20 09:01:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-20 09:01:20,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:01:20,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 09:01:20,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 09:01:20,200 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 09:01:20,201 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695201080201 2023-09-20 09:01:20,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 09:01:20,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-20 09:01:20,203 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:01:20,203 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:01:20,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 09:01:20,204 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 09:01:20,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-20 09:01:20,207 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 09:01:20,208 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695201080208 2023-09-20 09:01:20,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-20 09:01:20,224 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-20 09:01:20,224 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:20,225 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-20 09:01:20,225 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-20 09:01:20,225 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,226 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,227 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:20,227 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:20,227 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:20,227 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:20,228 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,228 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,228 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,228 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-20 09:01:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 09:01:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-20 09:01:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 09:01:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-20 09:01:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-20 09:01:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 09:01:20,231 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 09:01:20,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-20 09:01:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 09:01:20,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-20 09:01:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 09:01:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 09:01:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-20 09:01:20,233 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 09:01:20,233 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-20 09:01:20,233 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-20 09:01:20,233 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-20 09:01:20,233 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,234 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,234 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:20,235 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,235 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:20,236 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,236 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,236 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:20,236 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:20,237 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:20,237 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f3cbc70[Count = 1] remaining members to acquire global barrier 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:20,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-20 09:01:20,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f3cbc70[Count = 0] remaining members to acquire global barrier 2023-09-20 09:01:20,242 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-20 09:01:20,242 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 09:01:20,245 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 09:01:20,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,245 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-20 09:01:20,246 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 09:01:20,246 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:20,246 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:20,246 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,246 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:01:20,246 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:20,246 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:20,246 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:20,246 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:20,246 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:01:20,246 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. started... 2023-09-20 09:01:20,246 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. started... 2023-09-20 09:01:20,246 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 533db2630cabe82575f66716505deadc 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-20 09:01:20,246 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e587bcd7eb4da719b55a1f259ae54600 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-20 09:01:20,249 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 09:01:20,249 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:20,249 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-20 09:01:20,303 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:20,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 09:01:20,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:20,305 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:01:20,404 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920a69ec0d81c8e4a80ac34fce54411069d to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920a69ec0d81c8e4a80ac34fce54411069d 2023-09-20 09:01:20,427 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/.tmp/cf/4fa1bf3631ce49d1a68558fbff0431d9 2023-09-20 09:01:20,437 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/.tmp/cf/4fa1bf3631ce49d1a68558fbff0431d9 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf/4fa1bf3631ce49d1a68558fbff0431d9 2023-09-20 09:01:20,445 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf/4fa1bf3631ce49d1a68558fbff0431d9, entries=45, sequenceid=6, filesize=12.5 K 2023-09-20 09:01:20,447 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e587bcd7eb4da719b55a1f259ae54600 in 201ms, sequenceid=6, compaction requested=false 2023-09-20 09:01:20,448 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-20 09:01:20,448 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e587bcd7eb4da719b55a1f259ae54600: 2023-09-20 09:01:20,449 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-20 09:01:20,449 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:20,449 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf/4fa1bf3631ce49d1a68558fbff0431d9] hfiles 2023-09-20 09:01:20,449 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf/4fa1bf3631ce49d1a68558fbff0431d9 for snapshot=snaptb0-testExportWithTargetName 2023-09-20 09:01:20,467 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. completed. 2023-09-20 09:01:20,467 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:20,467 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-20 09:01:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:01:20,470 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 09:01:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-20 09:01:20,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:01:20,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-20 09:01:20,505 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:20,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 09:01:20,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:20,506 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-20 09:01:20,756 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920712e37719f7645a8be93d454bdfe3200 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230920712e37719f7645a8be93d454bdfe3200 2023-09-20 09:01:20,773 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/.tmp/cf/389c4905ae7342539abb0a2146f3dde4 2023-09-20 09:01:20,781 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/.tmp/cf/389c4905ae7342539abb0a2146f3dde4 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf/389c4905ae7342539abb0a2146f3dde4 2023-09-20 09:01:20,788 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf/389c4905ae7342539abb0a2146f3dde4, entries=5, sequenceid=6, filesize=5.7 K 2023-09-20 09:01:20,791 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 533db2630cabe82575f66716505deadc in 545ms, sequenceid=6, compaction requested=false 2023-09-20 09:01:20,792 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 533db2630cabe82575f66716505deadc: 2023-09-20 09:01:20,792 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-20 09:01:20,792 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:20,792 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf/389c4905ae7342539abb0a2146f3dde4] hfiles 2023-09-20 09:01:20,792 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf/389c4905ae7342539abb0a2146f3dde4 for snapshot=snaptb0-testExportWithTargetName 2023-09-20 09:01:20,805 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. completed. 2023-09-20 09:01:20,806 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:20,806 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:20,806 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:20,806 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,806 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-20 09:01:20,806 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:01:20,807 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:20,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 09:01:20,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:20,808 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-20 09:01:20,809 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 09:01:20,809 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,809 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:20,810 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-20 09:01:20,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:20,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:20,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:20,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:20,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39705,1695200470965': 2023-09-20 09:01:20,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-20 09:01:20,815 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-20 09:01:20,815 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:01:20,815 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:01:20,815 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-20 09:01:20,815 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:01:20,817 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:20,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:20,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:20,817 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:20,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,818 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,818 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:20,818 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:20,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,819 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,821 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:20,821 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 09:01:20,822 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,832 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,832 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:20,832 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:20,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:20,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:20,832 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:20,832 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-20 09:01:20,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:20,833 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:20,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:20,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:20,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:20,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-20 09:01:20,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:20,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-20 09:01:20,834 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:20,834 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:20,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:01:20,835 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:20,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:20,835 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:20,835 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:20,835 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,835 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920a69ec0d81c8e4a80ac34fce54411069d, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230920712e37719f7645a8be93d454bdfe3200] mob files 2023-09-20 09:01:20,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920a69ec0d81c8e4a80ac34fce54411069d 2023-09-20 09:01:20,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230920712e37719f7645a8be93d454bdfe3200 2023-09-20 09:01:20,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-20 09:01:20,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-20 09:01:20,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-20 09:01:20,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695200480201Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695200480856 (+655 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695200480856Loading Region manifests for snaptb0-testExportWithTargetName at 1695200480856Writing data manifest for snaptb0-testExportWithTargetName at 1695200480861 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695200480879 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695200480892 (+13 ms) 2023-09-20 09:01:20,895 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 09:01:20,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 693 msec 2023-09-20 09:01:21,309 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:21,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 09:01:21,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:01:21,312 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312 2023-09-20 09:01:21,313 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33191, tgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312, rawTgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:21,355 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:21,355 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1369222064_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-20 09:01:21,355 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-20 09:01:21,376 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-20 09:01:21,449 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,372 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-3206024940771587276.jar 2023-09-20 09:01:22,373 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,373 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,441 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-4894642910897694466.jar 2023-09-20 09:01:22,441 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,442 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,442 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,443 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,443 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,444 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:22,444 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:01:22,444 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:01:22,445 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:01:22,445 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:01:22,446 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:01:22,447 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:01:22,447 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:01:22,448 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:01:22,449 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:01:22,450 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:01:22,455 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:22,455 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:22,456 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:22,456 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:22,457 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:22,458 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:22,458 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:23,302 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:01:23,308 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-20 09:01:23,316 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-20 09:01:23,770 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:01:23,772 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:01:24,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0001_000001 (auth:SIMPLE) 2023-09-20 09:01:24,568 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:01:28,650 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0001_000001 (auth:SIMPLE) 2023-09-20 09:01:30,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0001_000001 (auth:SIMPLE) 2023-09-20 09:01:33,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0001_000001 (auth:SIMPLE) 2023-09-20 09:01:35,148 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:01:35,152 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:01:35,162 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-20 09:01:35,162 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:01:35,163 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:01:35,163 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-20 09:01:35,164 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-20 09:01:35,164 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-20 09:01:35,164 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312/.hbase-snapshot/testExportWithTargetName 2023-09-20 09:01:35,165 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-20 09:01:35,165 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200481312/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-20 09:01:35,176 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-20 09:01:35,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-20 09:01:35,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,195 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200495195"}]},"ts":"1695200495195"} 2023-09-20 09:01:35,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-20 09:01:35,197 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-20 09:01:35,227 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-20 09:01:35,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, UNASSIGN}] 2023-09-20 09:01:35,232 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, UNASSIGN 2023-09-20 09:01:35,232 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, UNASSIGN 2023-09-20 09:01:35,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e587bcd7eb4da719b55a1f259ae54600, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:35,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=533db2630cabe82575f66716505deadc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:35,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200495233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200495233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200495233"}]},"ts":"1695200495233"} 2023-09-20 09:01:35,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200495233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200495233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200495233"}]},"ts":"1695200495233"} 2023-09-20 09:01:35,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e587bcd7eb4da719b55a1f259ae54600, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:01:35,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 533db2630cabe82575f66716505deadc, server=jenkins-hbase4.apache.org,39705,1695200470965}] 2023-09-20 09:01:35,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-20 09:01:35,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:35,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 533db2630cabe82575f66716505deadc 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e587bcd7eb4da719b55a1f259ae54600, disabling compactions & flushes 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 533db2630cabe82575f66716505deadc, disabling compactions & flushes 2023-09-20 09:01:35,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:35,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. after waiting 0 ms 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. after waiting 0 ms 2023-09-20 09:01:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:35,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:01:35,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:01:35,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:35,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:35,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc. 2023-09-20 09:01:35,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600. 2023-09-20 09:01:35,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e587bcd7eb4da719b55a1f259ae54600: 2023-09-20 09:01:35,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 533db2630cabe82575f66716505deadc: 2023-09-20 09:01:35,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:35,418 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e587bcd7eb4da719b55a1f259ae54600, regionState=CLOSED 2023-09-20 09:01:35,418 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200495418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200495418"}]},"ts":"1695200495418"} 2023-09-20 09:01:35,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 533db2630cabe82575f66716505deadc 2023-09-20 09:01:35,419 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=533db2630cabe82575f66716505deadc, regionState=CLOSED 2023-09-20 09:01:35,419 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695200495419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200495419"}]},"ts":"1695200495419"} 2023-09-20 09:01:35,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-20 09:01:35,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e587bcd7eb4da719b55a1f259ae54600, server=jenkins-hbase4.apache.org,37597,1695200470915 in 185 msec 2023-09-20 09:01:35,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-20 09:01:35,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 533db2630cabe82575f66716505deadc, server=jenkins-hbase4.apache.org,39705,1695200470965 in 185 msec 2023-09-20 09:01:35,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e587bcd7eb4da719b55a1f259ae54600, UNASSIGN in 194 msec 2023-09-20 09:01:35,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-20 09:01:35,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=533db2630cabe82575f66716505deadc, UNASSIGN in 195 msec 2023-09-20 09:01:35,428 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200495428"}]},"ts":"1695200495428"} 2023-09-20 09:01:35,430 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-20 09:01:35,449 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-20 09:01:35,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 267 msec 2023-09-20 09:01:35,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-20 09:01:35,499 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-20 09:01:35,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-20 09:01:35,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-20 09:01:35,517 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,520 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-20 09:01:35,523 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc 2023-09-20 09:01:35,525 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:35,528 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/recovered.edits] 2023-09-20 09:01:35,528 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/recovered.edits] 2023-09-20 09:01:35,536 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf/4fa1bf3631ce49d1a68558fbff0431d9 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/cf/4fa1bf3631ce49d1a68558fbff0431d9 2023-09-20 09:01:35,536 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf/389c4905ae7342539abb0a2146f3dde4 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/cf/389c4905ae7342539abb0a2146f3dde4 2023-09-20 09:01:35,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc/recovered.edits/9.seqid 2023-09-20 09:01:35,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600/recovered.edits/9.seqid 2023-09-20 09:01:35,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/533db2630cabe82575f66716505deadc 2023-09-20 09:01:35,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportWithTargetName/e587bcd7eb4da719b55a1f259ae54600 2023-09-20 09:01:35,542 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-20 09:01:35,542 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-20 09:01:35,543 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-20 09:01:35,548 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920a69ec0d81c8e4a80ac34fce54411069d to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920a69ec0d81c8e4a80ac34fce54411069d 2023-09-20 09:01:35,550 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230920712e37719f7645a8be93d454bdfe3200 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230920712e37719f7645a8be93d454bdfe3200 2023-09-20 09:01:35,550 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-20 09:01:35,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,575 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-20 09:01:35,578 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-20 09:01:35,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-20 09:01:35,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200495580"}]},"ts":"9223372036854775807"} 2023-09-20 09:01:35,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200495580"}]},"ts":"9223372036854775807"} 2023-09-20 09:01:35,583 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 09:01:35,583 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 533db2630cabe82575f66716505deadc, NAME => 'testtb-testExportWithTargetName,,1695200478512.533db2630cabe82575f66716505deadc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e587bcd7eb4da719b55a1f259ae54600, NAME => 'testtb-testExportWithTargetName,1,1695200478512.e587bcd7eb4da719b55a1f259ae54600.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 09:01:35,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-20 09:01:35,583 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200495583"}]},"ts":"9223372036854775807"} 2023-09-20 09:01:35,585 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-20 09:01:35,595 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 09:01:35,597 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 09:01:35,595 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 09:01:35,595 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 09:01:35,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 09:01:35,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 122 msec 2023-09-20 09:01:35,657 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:35,657 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:35,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-20 09:01:35,657 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:35,657 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:35,657 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-20 09:01:35,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-20 09:01:35,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-20 09:01:35,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-20 09:01:35,658 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-20 09:01:35,658 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-20 09:01:35,658 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-20 09:01:35,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-20 09:01:35,661 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-20 09:01:35,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-20 09:01:35,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-20 09:01:35,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-20 09:01:35,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-20 09:01:35,721 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 706) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:36908 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:43049 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-427391689_1 at /127.0.0.1:36898 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:43343 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:60246 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-427391689_1 at /127.0.0.1:60216 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:34185 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=146 (was 134) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=11875 (was 12697) 2023-09-20 09:01:35,722 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-20 09:01:35,743 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=146, ProcessCount=168, AvailableMemoryMB=11874 2023-09-20 09:01:35,743 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-20 09:01:35,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 09:01:35,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:35,750 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:01:35,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-20 09:01:35,753 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:01:35,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 09:01:35,756 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:35,756 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:35,756 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 empty. 2023-09-20 09:01:35,756 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc empty. 2023-09-20 09:01:35,757 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:35,757 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:35,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-20 09:01:35,771 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:35,772 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34e8fe28ebfd2b31502cc6b3ac2c42fc, NAME => 'testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:35,772 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 729cc9aa42279eab4d561c7cc277eda0, NAME => 'testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:35,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:35,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 34e8fe28ebfd2b31502cc6b3ac2c42fc, disabling compactions & flushes 2023-09-20 09:01:35,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:35,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:35,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. after waiting 0 ms 2023-09-20 09:01:35,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:35,796 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:35,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 34e8fe28ebfd2b31502cc6b3ac2c42fc: 2023-09-20 09:01:35,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:35,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 729cc9aa42279eab4d561c7cc277eda0, disabling compactions & flushes 2023-09-20 09:01:35,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:35,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:35,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. after waiting 0 ms 2023-09-20 09:01:35,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:35,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:35,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 729cc9aa42279eab4d561c7cc277eda0: 2023-09-20 09:01:35,803 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:01:35,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200495804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200495804"}]},"ts":"1695200495804"} 2023-09-20 09:01:35,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200495804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200495804"}]},"ts":"1695200495804"} 2023-09-20 09:01:35,807 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:01:35,808 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:01:35,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200495808"}]},"ts":"1695200495808"} 2023-09-20 09:01:35,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-20 09:01:35,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 09:01:35,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:01:35,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:01:35,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:01:35,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:01:35,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:01:35,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, ASSIGN}] 2023-09-20 09:01:35,878 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, ASSIGN 2023-09-20 09:01:35,878 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, ASSIGN 2023-09-20 09:01:35,879 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45323,1695200471000; forceNewPlan=false, retain=false 2023-09-20 09:01:35,879 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:01:36,029 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:01:36,032 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=729cc9aa42279eab4d561c7cc277eda0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,032 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=34e8fe28ebfd2b31502cc6b3ac2c42fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200496032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200496032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200496032"}]},"ts":"1695200496032"} 2023-09-20 09:01:36,033 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200496032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200496032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200496032"}]},"ts":"1695200496032"} 2023-09-20 09:01:36,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 729cc9aa42279eab4d561c7cc277eda0, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:01:36,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 34e8fe28ebfd2b31502cc6b3ac2c42fc, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:01:36,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 09:01:36,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 729cc9aa42279eab4d561c7cc277eda0, NAME => 'testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 09:01:36,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. service=AccessControlService 2023-09-20 09:01:36,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:36,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:36,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,199 INFO [StoreOpener-729cc9aa42279eab4d561c7cc277eda0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34e8fe28ebfd2b31502cc6b3ac2c42fc, NAME => 'testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 09:01:36,200 DEBUG [StoreOpener-729cc9aa42279eab4d561c7cc277eda0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf 2023-09-20 09:01:36,200 DEBUG [StoreOpener-729cc9aa42279eab4d561c7cc277eda0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf 2023-09-20 09:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. service=AccessControlService 2023-09-20 09:01:36,201 INFO [StoreOpener-729cc9aa42279eab4d561c7cc277eda0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 729cc9aa42279eab4d561c7cc277eda0 columnFamilyName cf 2023-09-20 09:01:36,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,203 INFO [StoreOpener-729cc9aa42279eab4d561c7cc277eda0-1] regionserver.HStore(310): Store=729cc9aa42279eab4d561c7cc277eda0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:36,206 INFO [StoreOpener-34e8fe28ebfd2b31502cc6b3ac2c42fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,208 DEBUG [StoreOpener-34e8fe28ebfd2b31502cc6b3ac2c42fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf 2023-09-20 09:01:36,208 DEBUG [StoreOpener-34e8fe28ebfd2b31502cc6b3ac2c42fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf 2023-09-20 09:01:36,208 INFO [StoreOpener-34e8fe28ebfd2b31502cc6b3ac2c42fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e8fe28ebfd2b31502cc6b3ac2c42fc columnFamilyName cf 2023-09-20 09:01:36,209 INFO [StoreOpener-34e8fe28ebfd2b31502cc6b3ac2c42fc-1] regionserver.HStore(310): Store=34e8fe28ebfd2b31502cc6b3ac2c42fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:36,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:36,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:36,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 729cc9aa42279eab4d561c7cc277eda0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69659778, jitterRate=0.0380115807056427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:36,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 729cc9aa42279eab4d561c7cc277eda0: 2023-09-20 09:01:36,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0., pid=30, masterSystemTime=1695200496187 2023-09-20 09:01:36,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:36,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,218 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=729cc9aa42279eab4d561c7cc277eda0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,219 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200496218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200496218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200496218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200496218"}]},"ts":"1695200496218"} 2023-09-20 09:01:36,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:36,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34e8fe28ebfd2b31502cc6b3ac2c42fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71754333, jitterRate=0.06922288239002228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:36,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34e8fe28ebfd2b31502cc6b3ac2c42fc: 2023-09-20 09:01:36,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-20 09:01:36,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 729cc9aa42279eab4d561c7cc277eda0, server=jenkins-hbase4.apache.org,37597,1695200470915 in 185 msec 2023-09-20 09:01:36,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc., pid=31, masterSystemTime=1695200496192 2023-09-20 09:01:36,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, ASSIGN in 349 msec 2023-09-20 09:01:36,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,227 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=34e8fe28ebfd2b31502cc6b3ac2c42fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200496227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200496227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200496227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200496227"}]},"ts":"1695200496227"} 2023-09-20 09:01:36,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-20 09:01:36,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 34e8fe28ebfd2b31502cc6b3ac2c42fc, server=jenkins-hbase4.apache.org,45323,1695200471000 in 190 msec 2023-09-20 09:01:36,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-20 09:01:36,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, ASSIGN in 357 msec 2023-09-20 09:01:36,237 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:01:36,237 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200496237"}]},"ts":"1695200496237"} 2023-09-20 09:01:36,238 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-20 09:01:36,258 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:01:36,259 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-20 09:01:36,261 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 09:01:36,280 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:36,280 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:36,280 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:36,280 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:36,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:36,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:36,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:36,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:36,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 557 msec 2023-09-20 09:01:36,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 09:01:36,357 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-20 09:01:36,360 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-20 09:01:36,360 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,363 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:36,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:01:36,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200496378 (current time:1695200496378). 2023-09-20 09:01:36,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:01:36,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x597cd02b to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:36,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5658cd62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:36,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:36,393 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:36,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x597cd02b to 127.0.0.1:51278 2023-09-20 09:01:36,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:36,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x2135fd01 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e778c84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:36,406 DEBUG [hconnection-0xe5471f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:36,407 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:36,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:36,412 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:36,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2135fd01 to 127.0.0.1:51278 2023-09-20 09:01:36,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:36,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 09:01:36,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:01:36,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:01:36,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:01:36,418 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:01:36,419 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695201096419 2023-09-20 09:01:36,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:01:36,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-20 09:01:36,420 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:01:36,420 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:01:36,422 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:01:36,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 09:01:36,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-20 09:01:36,424 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 09:01:36,425 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695201096425 2023-09-20 09:01:36,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,439 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-20 09:01:36,439 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,441 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-20 09:01:36,441 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-20 09:01:36,441 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,441 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,443 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,443 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,443 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,443 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,444 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,444 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,444 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,444 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 09:01:36,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 09:01:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 09:01:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,448 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-20 09:01:36,447 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-20 09:01:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-20 09:01:36,451 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,451 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,459 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,459 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,460 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:36,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,460 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,460 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,460 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:36,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,460 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,460 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:36,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33b3eb0d[Count = 1] remaining members to acquire global barrier 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-20 09:01:36,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33b3eb0d[Count = 0] remaining members to acquire global barrier 2023-09-20 09:01:36,465 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 09:01:36,465 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:01:36,466 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,466 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:01:36,466 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:36,467 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,467 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:36,467 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,467 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,467 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. started... 2023-09-20 09:01:36,467 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,467 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:01:36,467 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:36,467 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 729cc9aa42279eab4d561c7cc277eda0: 2023-09-20 09:01:36,467 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:01:36,467 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. started... 2023-09-20 09:01:36,467 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-20 09:01:36,467 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:01:36,467 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,469 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34e8fe28ebfd2b31502cc6b3ac2c42fc: 2023-09-20 09:01:36,469 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:36,469 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:01:36,469 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,469 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:36,469 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:01:36,470 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 09:01:36,470 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,470 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-20 09:01:36,497 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. completed. 2023-09-20 09:01:36,497 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-20 09:01:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:01:36,498 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. completed. 2023-09-20 09:01:36,498 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-20 09:01:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:01:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 09:01:36,499 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-20 09:01:36,502 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 09:01:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-20 09:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:01:36,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 09:01:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:01:36,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 09:01:36,512 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-20 09:01:36,512 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:01:36,512 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:01:36,512 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,512 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,515 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,516 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,516 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,519 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,519 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,519 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,520 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:36,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:01:36,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:36,522 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:01:36,523 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,523 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,523 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-20 09:01:36,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,524 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,524 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,526 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,526 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,527 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,527 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,527 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 09:01:36,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-20 09:01:36,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,575 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:36,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695200496419Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695200496543 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695200496543Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695200496543Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695200496551 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695200496566 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695200496575 (+9 ms) 2023-09-20 09:01:36,578 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 09:01:36,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 158 msec 2023-09-20 09:01:36,685 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-20 09:01:36,722 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:36,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:01:36,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:01:36,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:01:36,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45323] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:01:36,734 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-20 09:01:36,734 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,734 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:36,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:01:36,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200496747 (current time:1695200496747). 2023-09-20 09:01:36,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:01:36,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x7da05489 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:36,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@271b2886, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:36,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:36,758 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:36,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7da05489 to 127.0.0.1:51278 2023-09-20 09:01:36,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:36,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x088e8adb to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:36,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d4ca2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:36,768 DEBUG [hconnection-0x1f9dcc46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:36,770 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:36,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:36,776 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:36,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x088e8adb to 127.0.0.1:51278 2023-09-20 09:01:36,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:36,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 09:01:36,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:01:36,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:01:36,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:01:36,782 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:01:36,783 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695201096783 2023-09-20 09:01:36,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-20 09:01:36,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:01:36,784 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:01:36,785 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:01:36,786 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:01:36,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 09:01:36,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-20 09:01:36,788 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 09:01:36,789 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695201096789 2023-09-20 09:01:36,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-20 09:01:36,802 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-20 09:01:36,802 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,804 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-20 09:01:36,804 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-20 09:01:36,804 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,804 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,805 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,805 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,805 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,805 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,806 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,806 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,806 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,807 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-20 09:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-20 09:01:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 09:01:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 09:01:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-20 09:01:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 09:01:36,809 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 09:01:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-20 09:01:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-20 09:01:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-20 09:01:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-20 09:01:36,810 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 09:01:36,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-20 09:01:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 09:01:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:36,811 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 09:01:36,812 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-20 09:01:36,812 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-20 09:01:36,814 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,814 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,814 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,814 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,814 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,814 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,815 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,815 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,815 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,816 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,816 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a039f4e[Count = 1] remaining members to acquire global barrier 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-20 09:01:36,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a039f4e[Count = 0] remaining members to acquire global barrier 2023-09-20 09:01:36,820 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 09:01:36,820 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:01:36,821 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:01:36,821 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-20 09:01:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,821 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:01:36,822 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,822 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:01:36,822 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,822 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:36,822 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. started... 2023-09-20 09:01:36,822 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:01:36,822 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:36,822 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 729cc9aa42279eab4d561c7cc277eda0 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-20 09:01:36,822 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:36,822 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,822 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:36,822 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. started... 2023-09-20 09:01:36,822 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 34e8fe28ebfd2b31502cc6b3ac2c42fc 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-20 09:01:36,823 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 09:01:36,824 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,824 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-20 09:01:36,859 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092039e7f97734754cd3909ad313b4e42555 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092039e7f97734754cd3909ad313b4e42555 2023-09-20 09:01:36,864 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920dd4173163c7046e5b980f2b1f565aef0 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920dd4173163c7046e5b980f2b1f565aef0 2023-09-20 09:01:36,885 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:36,889 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/.tmp/cf/4e0f47c00fc543779605d061b42355dd 2023-09-20 09:01:36,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:01:36,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:36,890 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:01:36,893 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/.tmp/cf/3ca908bbca7b448297cc30d5f0d49095 2023-09-20 09:01:36,902 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/.tmp/cf/4e0f47c00fc543779605d061b42355dd as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf/4e0f47c00fc543779605d061b42355dd 2023-09-20 09:01:36,903 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/.tmp/cf/3ca908bbca7b448297cc30d5f0d49095 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf/3ca908bbca7b448297cc30d5f0d49095 2023-09-20 09:01:36,909 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf/4e0f47c00fc543779605d061b42355dd, entries=49, sequenceid=6, filesize=13.2 K 2023-09-20 09:01:36,910 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf/3ca908bbca7b448297cc30d5f0d49095, entries=1, sequenceid=6, filesize=5.1 K 2023-09-20 09:01:36,910 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 34e8fe28ebfd2b31502cc6b3ac2c42fc in 88ms, sequenceid=6, compaction requested=false 2023-09-20 09:01:36,913 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34e8fe28ebfd2b31502cc6b3ac2c42fc: 2023-09-20 09:01:36,913 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-20 09:01:36,913 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:36,913 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf/4e0f47c00fc543779605d061b42355dd] hfiles 2023-09-20 09:01:36,913 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf/4e0f47c00fc543779605d061b42355dd for snapshot=snaptb0-testExportFileSystemState 2023-09-20 09:01:36,914 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 729cc9aa42279eab4d561c7cc277eda0 in 91ms, sequenceid=6, compaction requested=false 2023-09-20 09:01:36,914 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 729cc9aa42279eab4d561c7cc277eda0: 2023-09-20 09:01:36,914 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-20 09:01:36,914 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:36,914 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf/3ca908bbca7b448297cc30d5f0d49095] hfiles 2023-09-20 09:01:36,914 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf/3ca908bbca7b448297cc30d5f0d49095 for snapshot=snaptb0-testExportFileSystemState 2023-09-20 09:01:36,933 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. completed. 2023-09-20 09:01:36,933 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:36,933 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. completed. 2023-09-20 09:01:36,933 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-20 09:01:36,934 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:01:36,941 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 09:01:36,941 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,941 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,941 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-20 09:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,944 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 09:01:36,944 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,944 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-20 09:01:36,944 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:01:36,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 09:01:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 09:01:36,954 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-20 09:01:36,954 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:01:36,954 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:01:36,955 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-20 09:01:36,955 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,958 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,957 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:36,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,958 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,959 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,961 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,961 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:36,962 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 09:01:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:36,967 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,968 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:36,968 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:36,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,968 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,968 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,969 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 09:01:36,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-20 09:01:36,969 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-20 09:01:36,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-20 09:01:36,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:01:36,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:36,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092039e7f97734754cd3909ad313b4e42555, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920dd4173163c7046e5b980f2b1f565aef0] mob files 2023-09-20 09:01:36,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092039e7f97734754cd3909ad313b4e42555 2023-09-20 09:01:36,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920dd4173163c7046e5b980f2b1f565aef0 2023-09-20 09:01:36,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-20 09:01:36,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 09:01:37,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-20 09:01:37,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-20 09:01:37,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 09:01:37,011 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 09:01:37,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695200496783Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695200496980 (+197 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695200496980Loading Region manifests for snaptb0-testExportFileSystemState at 1695200496980Writing data manifest for snaptb0-testExportFileSystemState at 1695200496985 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695200497001 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695200497011 (+10 ms) 2023-09-20 09:01:37,014 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 09:01:37,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 230 msec 2023-09-20 09:01:37,090 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:37,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:01:37,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:01:37,092 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092 2023-09-20 09:01:37,092 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33191, tgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092, rawTgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:37,115 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:37,115 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1615438126_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 09:01:37,115 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-20 09:01:37,134 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 09:01:37,174 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:37,174 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:37,174 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:37,175 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,072 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-2940936025139643678.jar 2023-09-20 09:01:38,073 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,073 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,143 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-6246781338169232783.jar 2023-09-20 09:01:38,143 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,144 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,144 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,144 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,145 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,145 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:38,145 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:01:38,146 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:01:38,146 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:01:38,147 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:01:38,147 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:01:38,147 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:01:38,148 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:01:38,148 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:01:38,148 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:01:38,149 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:01:38,150 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:38,151 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:38,152 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:38,152 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:38,152 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:38,153 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:38,154 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:38,663 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:01:38,666 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-20 09:01:38,668 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-20 09:01:40,147 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:01:40,148 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:01:40,153 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0001_000001 (auth:SIMPLE) 2023-09-20 09:01:40,392 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0002_000001 (auth:SIMPLE) 2023-09-20 09:01:41,024 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:01:44,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0002_000001 (auth:SIMPLE) 2023-09-20 09:01:46,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0002_000001 (auth:SIMPLE) 2023-09-20 09:01:50,025 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0002_000001 (auth:SIMPLE) 2023-09-20 09:01:51,874 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:01:51,875 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:01:51,884 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-20 09:01:51,885 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:01:51,885 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:01:51,885 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-20 09:01:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-20 09:01:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-20 09:01:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-20 09:01:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-20 09:01:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200497092/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-20 09:01:51,895 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-20 09:01:51,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-20 09:01:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:51,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-20 09:01:51,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200511901"}]},"ts":"1695200511901"} 2023-09-20 09:01:51,903 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-20 09:01:51,906 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-20 09:01:51,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, UNASSIGN}] 2023-09-20 09:01:51,909 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, UNASSIGN 2023-09-20 09:01:51,909 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, UNASSIGN 2023-09-20 09:01:51,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=729cc9aa42279eab4d561c7cc277eda0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:51,909 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=34e8fe28ebfd2b31502cc6b3ac2c42fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:51,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200511909"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200511909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200511909"}]},"ts":"1695200511909"} 2023-09-20 09:01:51,910 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200511909"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200511909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200511909"}]},"ts":"1695200511909"} 2023-09-20 09:01:51,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 729cc9aa42279eab4d561c7cc277eda0, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:01:51,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 34e8fe28ebfd2b31502cc6b3ac2c42fc, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:01:52,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-20 09:01:52,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:52,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 729cc9aa42279eab4d561c7cc277eda0, disabling compactions & flushes 2023-09-20 09:01:52,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34e8fe28ebfd2b31502cc6b3ac2c42fc, disabling compactions & flushes 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:52,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. after waiting 0 ms 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. after waiting 0 ms 2023-09-20 09:01:52,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:52,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:01:52,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:01:52,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:52,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:01:52,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0. 2023-09-20 09:01:52,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc. 2023-09-20 09:01:52,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 729cc9aa42279eab4d561c7cc277eda0: 2023-09-20 09:01:52,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34e8fe28ebfd2b31502cc6b3ac2c42fc: 2023-09-20 09:01:52,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:52,079 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=729cc9aa42279eab4d561c7cc277eda0, regionState=CLOSED 2023-09-20 09:01:52,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:52,079 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200512078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200512078"}]},"ts":"1695200512078"} 2023-09-20 09:01:52,079 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=34e8fe28ebfd2b31502cc6b3ac2c42fc, regionState=CLOSED 2023-09-20 09:01:52,079 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695200512079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200512079"}]},"ts":"1695200512079"} 2023-09-20 09:01:52,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-20 09:01:52,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 729cc9aa42279eab4d561c7cc277eda0, server=jenkins-hbase4.apache.org,37597,1695200470915 in 169 msec 2023-09-20 09:01:52,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-20 09:01:52,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 34e8fe28ebfd2b31502cc6b3ac2c42fc, server=jenkins-hbase4.apache.org,45323,1695200471000 in 169 msec 2023-09-20 09:01:52,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=729cc9aa42279eab4d561c7cc277eda0, UNASSIGN in 177 msec 2023-09-20 09:01:52,085 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-20 09:01:52,085 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34e8fe28ebfd2b31502cc6b3ac2c42fc, UNASSIGN in 177 msec 2023-09-20 09:01:52,086 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200512086"}]},"ts":"1695200512086"} 2023-09-20 09:01:52,087 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-20 09:01:52,089 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-20 09:01:52,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-09-20 09:01:52,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-20 09:01:52,203 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-20 09:01:52,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-20 09:01:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:52,207 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:52,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-20 09:01:52,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:52,210 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-20 09:01:52,212 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,212 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,212 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,212 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-20 09:01:52,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-20 09:01:52,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-20 09:01:52,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-20 09:01:52,213 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:52,213 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,215 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,216 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/recovered.edits] 2023-09-20 09:01:52,216 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/recovered.edits] 2023-09-20 09:01:52,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-20 09:01:52,220 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf/4e0f47c00fc543779605d061b42355dd to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/cf/4e0f47c00fc543779605d061b42355dd 2023-09-20 09:01:52,221 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf/3ca908bbca7b448297cc30d5f0d49095 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/cf/3ca908bbca7b448297cc30d5f0d49095 2023-09-20 09:01:52,224 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc/recovered.edits/9.seqid 2023-09-20 09:01:52,224 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0/recovered.edits/9.seqid 2023-09-20 09:01:52,225 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/34e8fe28ebfd2b31502cc6b3ac2c42fc 2023-09-20 09:01:52,225 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemState/729cc9aa42279eab4d561c7cc277eda0 2023-09-20 09:01:52,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-20 09:01:52,225 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-20 09:01:52,226 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-20 09:01:52,230 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092039e7f97734754cd3909ad313b4e42555 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092039e7f97734754cd3909ad313b4e42555 2023-09-20 09:01:52,231 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920dd4173163c7046e5b980f2b1f565aef0 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920dd4173163c7046e5b980f2b1f565aef0 2023-09-20 09:01:52,232 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-20 09:01:52,235 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:52,238 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-20 09:01:52,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-20 09:01:52,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:52,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-20 09:01:52,241 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200512241"}]},"ts":"9223372036854775807"} 2023-09-20 09:01:52,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200512241"}]},"ts":"9223372036854775807"} 2023-09-20 09:01:52,244 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 09:01:52,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 729cc9aa42279eab4d561c7cc277eda0, NAME => 'testtb-testExportFileSystemState,,1695200495745.729cc9aa42279eab4d561c7cc277eda0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 34e8fe28ebfd2b31502cc6b3ac2c42fc, NAME => 'testtb-testExportFileSystemState,1,1695200495745.34e8fe28ebfd2b31502cc6b3ac2c42fc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 09:01:52,244 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-20 09:01:52,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200512244"}]},"ts":"9223372036854775807"} 2023-09-20 09:01:52,246 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-20 09:01:52,248 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 09:01:52,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-09-20 09:01:52,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-20 09:01:52,318 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-20 09:01:52,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-20 09:01:52,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-20 09:01:52,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-20 09:01:52,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-20 09:01:52,362 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 756) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:36507 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_107854841_1 at /127.0.0.1:44066 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:59492 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:44090 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:41316 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 925) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 146) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=11737 (was 11874) 2023-09-20 09:01:52,362 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-20 09:01:52,387 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=168, AvailableMemoryMB=11737 2023-09-20 09:01:52,388 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-20 09:01:52,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 09:01:52,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:01:52,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:01:52,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-20 09:01:52,395 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:01:52,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 09:01:52,398 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,398 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,399 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da empty. 2023-09-20 09:01:52,399 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 empty. 2023-09-20 09:01:52,399 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,400 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-20 09:01:52,412 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-20 09:01:52,414 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 59b26790c0d67c5bae6e909dfb6530da, NAME => 'testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:52,414 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a87333ba5d31fc3b727d2812f61a184, NAME => 'testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 59b26790c0d67c5bae6e909dfb6530da, disabling compactions & flushes 2023-09-20 09:01:52,433 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. after waiting 0 ms 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,433 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8a87333ba5d31fc3b727d2812f61a184, disabling compactions & flushes 2023-09-20 09:01:52,433 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 59b26790c0d67c5bae6e909dfb6530da: 2023-09-20 09:01:52,434 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. after waiting 0 ms 2023-09-20 09:01:52,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,434 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,434 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8a87333ba5d31fc3b727d2812f61a184: 2023-09-20 09:01:52,437 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:01:52,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200512438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200512438"}]},"ts":"1695200512438"} 2023-09-20 09:01:52,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200512438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200512438"}]},"ts":"1695200512438"} 2023-09-20 09:01:52,441 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:01:52,442 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:01:52,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200512442"}]},"ts":"1695200512442"} 2023-09-20 09:01:52,443 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-20 09:01:52,446 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:01:52,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:01:52,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:01:52,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:01:52,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:01:52,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, ASSIGN}] 2023-09-20 09:01:52,451 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, ASSIGN 2023-09-20 09:01:52,451 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, ASSIGN 2023-09-20 09:01:52,452 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45323,1695200471000; forceNewPlan=false, retain=false 2023-09-20 09:01:52,452 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:01:52,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 09:01:52,602 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:01:52,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=59b26790c0d67c5bae6e909dfb6530da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:52,605 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8a87333ba5d31fc3b727d2812f61a184, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:52,605 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200512605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200512605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200512605"}]},"ts":"1695200512605"} 2023-09-20 09:01:52,605 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200512605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200512605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200512605"}]},"ts":"1695200512605"} 2023-09-20 09:01:52,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 59b26790c0d67c5bae6e909dfb6530da, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:01:52,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 8a87333ba5d31fc3b727d2812f61a184, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:01:52,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 09:01:52,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a87333ba5d31fc3b727d2812f61a184, NAME => 'testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59b26790c0d67c5bae6e909dfb6530da, NAME => 'testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. service=AccessControlService 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. service=AccessControlService 2023-09-20 09:01:52,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:52,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,765 INFO [StoreOpener-8a87333ba5d31fc3b727d2812f61a184-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,765 INFO [StoreOpener-59b26790c0d67c5bae6e909dfb6530da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,766 DEBUG [StoreOpener-8a87333ba5d31fc3b727d2812f61a184-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf 2023-09-20 09:01:52,766 DEBUG [StoreOpener-59b26790c0d67c5bae6e909dfb6530da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf 2023-09-20 09:01:52,766 DEBUG [StoreOpener-59b26790c0d67c5bae6e909dfb6530da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf 2023-09-20 09:01:52,766 DEBUG [StoreOpener-8a87333ba5d31fc3b727d2812f61a184-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf 2023-09-20 09:01:52,767 INFO [StoreOpener-8a87333ba5d31fc3b727d2812f61a184-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a87333ba5d31fc3b727d2812f61a184 columnFamilyName cf 2023-09-20 09:01:52,767 INFO [StoreOpener-59b26790c0d67c5bae6e909dfb6530da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59b26790c0d67c5bae6e909dfb6530da columnFamilyName cf 2023-09-20 09:01:52,768 INFO [StoreOpener-8a87333ba5d31fc3b727d2812f61a184-1] regionserver.HStore(310): Store=8a87333ba5d31fc3b727d2812f61a184/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:52,768 INFO [StoreOpener-59b26790c0d67c5bae6e909dfb6530da-1] regionserver.HStore(310): Store=59b26790c0d67c5bae6e909dfb6530da/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:01:52,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:01:52,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:01:52,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:52,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:01:52,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a87333ba5d31fc3b727d2812f61a184; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71679751, jitterRate=0.06811152398586273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:52,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59b26790c0d67c5bae6e909dfb6530da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63214652, jitterRate=-0.05802828073501587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:01:52,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a87333ba5d31fc3b727d2812f61a184: 2023-09-20 09:01:52,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59b26790c0d67c5bae6e909dfb6530da: 2023-09-20 09:01:52,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184., pid=46, masterSystemTime=1695200512759 2023-09-20 09:01:52,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da., pid=45, masterSystemTime=1695200512759 2023-09-20 09:01:52,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:52,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8a87333ba5d31fc3b727d2812f61a184, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:52,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200512778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200512778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200512778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200512778"}]},"ts":"1695200512778"} 2023-09-20 09:01:52,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:52,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=59b26790c0d67c5bae6e909dfb6530da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:52,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200512779"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200512779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200512779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200512779"}]},"ts":"1695200512779"} 2023-09-20 09:01:52,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-20 09:01:52,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 8a87333ba5d31fc3b727d2812f61a184, server=jenkins-hbase4.apache.org,37597,1695200470915 in 172 msec 2023-09-20 09:01:52,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-20 09:01:52,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 59b26790c0d67c5bae6e909dfb6530da, server=jenkins-hbase4.apache.org,45323,1695200471000 in 174 msec 2023-09-20 09:01:52,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, ASSIGN in 334 msec 2023-09-20 09:01:52,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-20 09:01:52,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, ASSIGN in 335 msec 2023-09-20 09:01:52,789 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:01:52,789 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200512789"}]},"ts":"1695200512789"} 2023-09-20 09:01:52,790 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-20 09:01:52,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:01:52,794 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-20 09:01:52,796 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-20 09:01:52,797 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,797 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,797 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,797 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:01:52,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:52,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:52,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:52,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 09:01:52,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 409 msec 2023-09-20 09:01:52,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 09:01:52,999 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-20 09:01:53,002 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-20 09:01:53,002 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:53,004 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:53,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 09:01:53,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200513016 (current time:1695200513016). 2023-09-20 09:01:53,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:01:53,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x35634445 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:53,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64c59c41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:53,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:53,028 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:53,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35634445 to 127.0.0.1:51278 2023-09-20 09:01:53,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:53,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x17be4890 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:53,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3850774e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:53,037 DEBUG [hconnection-0x70bfc391-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:53,039 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:53,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:53,045 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:53,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17be4890 to 127.0.0.1:51278 2023-09-20 09:01:53,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:53,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-20 09:01:53,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:01:53,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 09:01:53,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 09:01:53,051 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 09:01:53,051 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695201113051 2023-09-20 09:01:53,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 09:01:53,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-20 09:01:53,053 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:01:53,053 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:01:53,056 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 09:01:53,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 09:01:53,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-20 09:01:53,058 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 09:01:53,059 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695201113059 2023-09-20 09:01:53,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,070 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-20 09:01:53,070 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,071 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-20 09:01:53,071 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-20 09:01:53,071 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,071 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,073 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,073 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,073 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,073 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,073 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,073 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,073 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,073 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:01:53,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 09:01:53,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,077 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 09:01:53,077 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 09:01:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 09:01:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 09:01:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-20 09:01:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-20 09:01:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-20 09:01:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 09:01:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-20 09:01:53,082 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 09:01:53,082 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-20 09:01:53,082 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-20 09:01:53,084 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,084 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,085 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,085 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:53,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40766142[Count = 1] remaining members to acquire global barrier 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-20 09:01:53,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40766142[Count = 0] remaining members to acquire global barrier 2023-09-20 09:01:53,089 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-20 09:01:53,089 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,090 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,090 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,090 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,091 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 09:01:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 09:01:53,091 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,091 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:53,091 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:01:53,091 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. started... 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-20 09:01:53,091 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:53,092 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a87333ba5d31fc3b727d2812f61a184: 2023-09-20 09:01:53,092 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:53,092 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. started... 2023-09-20 09:01:53,091 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:01:53,092 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,092 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59b26790c0d67c5bae6e909dfb6530da: 2023-09-20 09:01:53,092 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:53,093 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:01:53,093 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,093 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:53,093 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:01:53,100 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 09:01:53,100 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,100 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-20 09:01:53,105 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. completed. 2023-09-20 09:01:53,105 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:53,105 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. completed. 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,105 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:01:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-20 09:01:53,106 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:01:53,107 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 09:01:53,107 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,107 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,107 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-20 09:01:53,108 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,107 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 09:01:53,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,108 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,109 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-20 09:01:53,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:01:53,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-20 09:01:53,116 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-20 09:01:53,116 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:01:53,116 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:01:53,116 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,116 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:01:53,117 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,117 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,117 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,117 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,117 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,118 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,118 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,118 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,118 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,119 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,120 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,121 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,121 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,124 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-20 09:01:53,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:01:53,124 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,126 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,126 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,126 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,126 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,127 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,127 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,127 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 09:01:53,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,153 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:53,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 09:01:53,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:53,154 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:01:53,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-20 09:01:53,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,158 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-20 09:01:53,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695200513052Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695200513135 (+83 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695200513135Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695200513135Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695200513142 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695200513150 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695200513157 (+7 ms) 2023-09-20 09:01:53,160 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 09:01:53,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 107 msec 2023-09-20 09:01:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:53,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 09:01:53,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:01:53,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45323] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:01:53,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:01:53,363 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-20 09:01:53,363 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:53,363 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:01:53,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 09:01:53,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200513373 (current time:1695200513373). 2023-09-20 09:01:53,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:01:53,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x40d4ded9 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:53,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dd1e8d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:53,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:53,391 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:53,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40d4ded9 to 127.0.0.1:51278 2023-09-20 09:01:53,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:53,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x2c840014 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:01:53,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ac0314b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:01:53,400 DEBUG [hconnection-0x895ef86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:53,401 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:53,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:01:53,406 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:01:53,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c840014 to 127.0.0.1:51278 2023-09-20 09:01:53,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:01:53,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-20 09:01:53,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:01:53,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 09:01:53,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 09:01:53,411 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 09:01:53,412 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695201113412 2023-09-20 09:01:53,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 09:01:53,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-20 09:01:53,413 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:01:53,413 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:01:53,414 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 09:01:53,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 09:01:53,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-20 09:01:53,416 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 09:01:53,417 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695201113417 2023-09-20 09:01:53,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-20 09:01:53,428 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-20 09:01:53,428 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,429 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-20 09:01:53,429 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-20 09:01:53,429 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,430 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,432 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,432 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,432 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,432 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,433 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,433 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,433 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,433 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:01:53,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 09:01:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 09:01:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 09:01:53,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-20 09:01:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 09:01:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 09:01:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-20 09:01:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-20 09:01:53,438 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 09:01:53,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-20 09:01:53,438 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-20 09:01:53,438 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 09:01:53,438 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:01:53,438 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-20 09:01:53,439 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 09:01:53,439 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-20 09:01:53,439 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-20 09:01:53,439 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,439 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,439 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:53,440 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,440 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,441 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@af1f385[Count = 1] remaining members to acquire global barrier 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-20 09:01:53,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@af1f385[Count = 0] remaining members to acquire global barrier 2023-09-20 09:01:53,445 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-20 09:01:53,445 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 09:01:53,447 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 09:01:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 09:01:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-20 09:01:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:01:53,448 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:53,448 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:53,448 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. started... 2023-09-20 09:01:53,448 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:01:53,448 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 59b26790c0d67c5bae6e909dfb6530da 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-20 09:01:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 09:01:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-20 09:01:53,454 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:01:53,455 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:01:53,455 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:53,455 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. started... 2023-09-20 09:01:53,455 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a87333ba5d31fc3b727d2812f61a184 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-20 09:01:53,486 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309200069b8d743c345dd85946c4dcdba9852 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309200069b8d743c345dd85946c4dcdba9852 2023-09-20 09:01:53,493 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920722371b233014acea6f501c256a9d554 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230920722371b233014acea6f501c256a9d554 2023-09-20 09:01:53,499 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/.tmp/cf/1224f357d70847579dc62f8b4b02bbcf 2023-09-20 09:01:53,505 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/.tmp/cf/f59bf26724944db893e9bac3dd24231d 2023-09-20 09:01:53,506 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/.tmp/cf/1224f357d70847579dc62f8b4b02bbcf as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf/1224f357d70847579dc62f8b4b02bbcf 2023-09-20 09:01:53,510 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/.tmp/cf/f59bf26724944db893e9bac3dd24231d as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf/f59bf26724944db893e9bac3dd24231d 2023-09-20 09:01:53,511 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf/1224f357d70847579dc62f8b4b02bbcf, entries=5, sequenceid=6, filesize=5.7 K 2023-09-20 09:01:53,512 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 59b26790c0d67c5bae6e909dfb6530da in 64ms, sequenceid=6, compaction requested=false 2023-09-20 09:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-20 09:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59b26790c0d67c5bae6e909dfb6530da: 2023-09-20 09:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-20 09:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:53,513 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf/1224f357d70847579dc62f8b4b02bbcf] hfiles 2023-09-20 09:01:53,513 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf/1224f357d70847579dc62f8b4b02bbcf for snapshot=snaptb0-testConsecutiveExports 2023-09-20 09:01:53,513 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:53,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 09:01:53,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:01:53,515 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:01:53,515 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf/f59bf26724944db893e9bac3dd24231d, entries=45, sequenceid=6, filesize=12.4 K 2023-09-20 09:01:53,516 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8a87333ba5d31fc3b727d2812f61a184 in 61ms, sequenceid=6, compaction requested=false 2023-09-20 09:01:53,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a87333ba5d31fc3b727d2812f61a184: 2023-09-20 09:01:53,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-20 09:01:53,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:01:53,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf/f59bf26724944db893e9bac3dd24231d] hfiles 2023-09-20 09:01:53,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf/f59bf26724944db893e9bac3dd24231d for snapshot=snaptb0-testConsecutiveExports 2023-09-20 09:01:53,523 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. completed. 2023-09-20 09:01:53,523 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-20 09:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:01:53,525 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 09:01:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-20 09:01:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,529 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. completed. 2023-09-20 09:01:53,529 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:01:53,529 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:01:53,529 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:01:53,529 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,529 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-20 09:01:53,529 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:01:53,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,530 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 09:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-20 09:01:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-20 09:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:01:53,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-20 09:01:53,536 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-20 09:01:53,536 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:01:53,536 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:01:53,536 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-20 09:01:53,536 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:01:53,539 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,539 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,539 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,539 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:01:53,540 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,539 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,540 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:01:53,540 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,540 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,541 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:01:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,543 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:01:53,543 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 09:01:53,544 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,550 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,550 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,550 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,550 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:01:53,551 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,550 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,551 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:01:53,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,550 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-20 09:01:53,551 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:01:53,551 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:01:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:01:53,553 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-20 09:01:53,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,553 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:01:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:01:53,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-20 09:01:53,553 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:01:53,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:01:53,554 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,554 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:01:53,554 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:01:53,554 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,554 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230920722371b233014acea6f501c256a9d554, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309200069b8d743c345dd85946c4dcdba9852] mob files 2023-09-20 09:01:53,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230920722371b233014acea6f501c256a9d554 2023-09-20 09:01:53,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309200069b8d743c345dd85946c4dcdba9852 2023-09-20 09:01:53,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-20 09:01:53,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-20 09:01:53,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,583 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695200513412Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695200513564 (+152 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695200513564Loading Region manifests for snaptb0-testConsecutiveExports at 1695200513564Writing data manifest for snaptb0-testConsecutiveExports at 1695200513567 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695200513575 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695200513583 (+8 ms) 2023-09-20 09:01:53,586 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 09:01:53,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 173 msec 2023-09-20 09:01:53,715 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:01:53,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 09:01:53,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:01:53,716 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716 2023-09-20 09:01:53,717 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:53,745 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:01:53,745 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@52d96673, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,745 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-20 09:01:53,754 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:01:53,766 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:53,766 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:53,767 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:53,767 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,644 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-8630426760824647144.jar 2023-09-20 09:01:54,644 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,644 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,711 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-7871445809328216934.jar 2023-09-20 09:01:54,712 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,712 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,712 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,713 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,713 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,713 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:01:54,714 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:01:54,714 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:01:54,714 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:01:54,715 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:01:54,715 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:01:54,716 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:01:54,716 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:01:54,716 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:01:54,717 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:01:54,717 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:01:54,718 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:54,718 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:54,719 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:54,719 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:54,719 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:01:54,720 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:54,720 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:01:55,078 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:01:55,081 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-20 09:01:55,083 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-20 09:01:56,200 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:01:56,200 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:01:56,204 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0002_000001 (auth:SIMPLE) 2023-09-20 09:01:57,010 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0003_000001 (auth:SIMPLE) 2023-09-20 09:01:57,670 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:02:00,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0003_000001 (auth:SIMPLE) 2023-09-20 09:02:02,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0003_000001 (auth:SIMPLE) 2023-09-20 09:02:05,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0003_000001 (auth:SIMPLE) 2023-09-20 09:02:07,237 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:02:07,237 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:02:07,241 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-20 09:02:07,242 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:02:07,242 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:02:07,242 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 09:02:07,245 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 09:02:07,245 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 09:02:07,245 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5287ad29 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 09:02:07,245 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 09:02:07,245 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 09:02:07,246 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:07,268 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:07,268 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@16fe6333, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:02:07,268 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-20 09:02:07,279 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 09:02:07,291 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:07,291 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:07,291 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:07,292 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,160 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-402807365457826856.jar 2023-09-20 09:02:08,161 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,161 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,228 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-8801800779556846389.jar 2023-09-20 09:02:08,228 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,228 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,229 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,229 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,230 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,230 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:08,230 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:02:08,231 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:02:08,231 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:02:08,231 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:02:08,232 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:02:08,232 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:02:08,233 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:02:08,233 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:02:08,233 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:02:08,234 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:02:08,234 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:08,235 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:08,235 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:08,236 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:08,236 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:08,236 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:08,619 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:02:08,622 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-20 09:02:08,624 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-20 09:02:11,445 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:11,445 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:11,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0003_000001 (auth:SIMPLE) 2023-09-20 09:02:12,213 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0004_000001 (auth:SIMPLE) 2023-09-20 09:02:15,951 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0004_000001 (auth:SIMPLE) 2023-09-20 09:02:18,163 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0004_000001 (auth:SIMPLE) 2023-09-20 09:02:20,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0004_000001 (auth:SIMPLE) 2023-09-20 09:02:22,794 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:02:22,794 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:02:22,797 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-20 09:02:22,797 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:02:22,797 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:02:22,797 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 09:02:22,801 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 09:02:22,801 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 09:02:22,801 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5287ad29 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 09:02:22,802 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 09:02:22,802 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/local-export-1695200513716/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 09:02:22,814 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-20 09:02:22,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-20 09:02:22,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:22,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-20 09:02:22,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200542818"}]},"ts":"1695200542818"} 2023-09-20 09:02:22,820 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-20 09:02:22,821 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-20 09:02:22,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, UNASSIGN}] 2023-09-20 09:02:22,824 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, UNASSIGN 2023-09-20 09:02:22,824 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, UNASSIGN 2023-09-20 09:02:22,825 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8a87333ba5d31fc3b727d2812f61a184, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:22,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200542825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200542825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200542825"}]},"ts":"1695200542825"} 2023-09-20 09:02:22,825 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=59b26790c0d67c5bae6e909dfb6530da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:22,825 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200542825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200542825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200542825"}]},"ts":"1695200542825"} 2023-09-20 09:02:22,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 8a87333ba5d31fc3b727d2812f61a184, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:22,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 59b26790c0d67c5bae6e909dfb6530da, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:02:22,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-20 09:02:22,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:02:22,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:02:22,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a87333ba5d31fc3b727d2812f61a184, disabling compactions & flushes 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59b26790c0d67c5bae6e909dfb6530da, disabling compactions & flushes 2023-09-20 09:02:22,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:02:22,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. after waiting 0 ms 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. after waiting 0 ms 2023-09-20 09:02:22,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:02:22,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:02:22,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:02:22,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:22,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184. 2023-09-20 09:02:22,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a87333ba5d31fc3b727d2812f61a184: 2023-09-20 09:02:22,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:22,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da. 2023-09-20 09:02:22,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59b26790c0d67c5bae6e909dfb6530da: 2023-09-20 09:02:22,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:02:22,997 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8a87333ba5d31fc3b727d2812f61a184, regionState=CLOSED 2023-09-20 09:02:22,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:02:22,997 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200542997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200542997"}]},"ts":"1695200542997"} 2023-09-20 09:02:22,998 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=59b26790c0d67c5bae6e909dfb6530da, regionState=CLOSED 2023-09-20 09:02:22,998 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695200542998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200542998"}]},"ts":"1695200542998"} 2023-09-20 09:02:23,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-20 09:02:23,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 8a87333ba5d31fc3b727d2812f61a184, server=jenkins-hbase4.apache.org,37597,1695200470915 in 173 msec 2023-09-20 09:02:23,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-20 09:02:23,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 59b26790c0d67c5bae6e909dfb6530da, server=jenkins-hbase4.apache.org,45323,1695200471000 in 172 msec 2023-09-20 09:02:23,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8a87333ba5d31fc3b727d2812f61a184, UNASSIGN in 178 msec 2023-09-20 09:02:23,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-20 09:02:23,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=59b26790c0d67c5bae6e909dfb6530da, UNASSIGN in 179 msec 2023-09-20 09:02:23,004 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200543004"}]},"ts":"1695200543004"} 2023-09-20 09:02:23,005 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-20 09:02:23,006 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-20 09:02:23,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-09-20 09:02:23,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-20 09:02:23,120 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-20 09:02:23,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-20 09:02:23,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:23,125 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:23,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-20 09:02:23,125 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:23,128 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-20 09:02:23,131 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:02:23,131 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:02:23,132 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,132 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,132 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,132 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 09:02:23,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 09:02:23,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 09:02:23,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 09:02:23,133 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/recovered.edits] 2023-09-20 09:02:23,133 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/recovered.edits] 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-20 09:02:23,139 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf/1224f357d70847579dc62f8b4b02bbcf to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/cf/1224f357d70847579dc62f8b4b02bbcf 2023-09-20 09:02:23,139 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf/f59bf26724944db893e9bac3dd24231d to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/cf/f59bf26724944db893e9bac3dd24231d 2023-09-20 09:02:23,143 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da/recovered.edits/9.seqid 2023-09-20 09:02:23,143 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184/recovered.edits/9.seqid 2023-09-20 09:02:23,144 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/59b26790c0d67c5bae6e909dfb6530da 2023-09-20 09:02:23,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testConsecutiveExports/8a87333ba5d31fc3b727d2812f61a184 2023-09-20 09:02:23,144 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-20 09:02:23,144 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-20 09:02:23,145 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-20 09:02:23,149 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230920722371b233014acea6f501c256a9d554 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230920722371b233014acea6f501c256a9d554 2023-09-20 09:02:23,150 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309200069b8d743c345dd85946c4dcdba9852 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309200069b8d743c345dd85946c4dcdba9852 2023-09-20 09:02:23,151 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-20 09:02:23,153 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:23,156 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-20 09:02:23,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-20 09:02:23,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:23,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-20 09:02:23,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200543159"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:23,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200543159"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:23,161 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 09:02:23,161 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 59b26790c0d67c5bae6e909dfb6530da, NAME => 'testtb-testConsecutiveExports,,1695200512389.59b26790c0d67c5bae6e909dfb6530da.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a87333ba5d31fc3b727d2812f61a184, NAME => 'testtb-testConsecutiveExports,1,1695200512389.8a87333ba5d31fc3b727d2812f61a184.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 09:02:23,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-20 09:02:23,161 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200543161"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:23,162 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-20 09:02:23,164 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 09:02:23,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 43 msec 2023-09-20 09:02:23,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-20 09:02:23,237 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-20 09:02:23,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-20 09:02:23,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-20 09:02:23,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-20 09:02:23,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-20 09:02:23,277 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 766), OpenFileDescriptor=899 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=191 (was 190) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=11621 (was 11737) 2023-09-20 09:02:23,277 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-09-20 09:02:23,296 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=168, AvailableMemoryMB=11642 2023-09-20 09:02:23,296 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-09-20 09:02:23,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 09:02:23,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,302 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:02:23,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-20 09:02:23,303 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:02:23,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 09:02:23,305 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,306 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 empty. 2023-09-20 09:02:23,306 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,306 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,306 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 empty. 2023-09-20 09:02:23,307 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,307 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-20 09:02:23,320 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-20 09:02:23,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 80d6b07ba0a28258ab64889b837cbd68, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:23,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6d755b6bbca94314dd5ddee5fc119f71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:23,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:23,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 80d6b07ba0a28258ab64889b837cbd68, disabling compactions & flushes 2023-09-20 09:02:23,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. after waiting 0 ms 2023-09-20 09:02:23,332 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,332 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,332 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 80d6b07ba0a28258ab64889b837cbd68: 2023-09-20 09:02:23,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:23,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6d755b6bbca94314dd5ddee5fc119f71, disabling compactions & flushes 2023-09-20 09:02:23,333 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. after waiting 0 ms 2023-09-20 09:02:23,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,333 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6d755b6bbca94314dd5ddee5fc119f71: 2023-09-20 09:02:23,335 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:02:23,336 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200543336"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200543336"}]},"ts":"1695200543336"} 2023-09-20 09:02:23,336 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200543336"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200543336"}]},"ts":"1695200543336"} 2023-09-20 09:02:23,343 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:02:23,344 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:02:23,344 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200543344"}]},"ts":"1695200543344"} 2023-09-20 09:02:23,345 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-20 09:02:23,349 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:02:23,350 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:02:23,350 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:02:23,350 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:02:23,350 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:02:23,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, ASSIGN}] 2023-09-20 09:02:23,353 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, ASSIGN 2023-09-20 09:02:23,353 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, ASSIGN 2023-09-20 09:02:23,354 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39705,1695200470965; forceNewPlan=false, retain=false 2023-09-20 09:02:23,354 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:02:23,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 09:02:23,504 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:02:23,506 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6d755b6bbca94314dd5ddee5fc119f71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,506 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=80d6b07ba0a28258ab64889b837cbd68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200543506"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200543506"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200543506"}]},"ts":"1695200543506"} 2023-09-20 09:02:23,507 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200543506"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200543506"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200543506"}]},"ts":"1695200543506"} 2023-09-20 09:02:23,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 6d755b6bbca94314dd5ddee5fc119f71, server=jenkins-hbase4.apache.org,39705,1695200470965}] 2023-09-20 09:02:23,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 80d6b07ba0a28258ab64889b837cbd68, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:23,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 09:02:23,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d755b6bbca94314dd5ddee5fc119f71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 09:02:23,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80d6b07ba0a28258ab64889b837cbd68, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 09:02:23,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. service=AccessControlService 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. service=AccessControlService 2023-09-20 09:02:23,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:23,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,669 INFO [StoreOpener-6d755b6bbca94314dd5ddee5fc119f71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,669 INFO [StoreOpener-80d6b07ba0a28258ab64889b837cbd68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,671 DEBUG [StoreOpener-6d755b6bbca94314dd5ddee5fc119f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf 2023-09-20 09:02:23,671 DEBUG [StoreOpener-80d6b07ba0a28258ab64889b837cbd68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf 2023-09-20 09:02:23,671 DEBUG [StoreOpener-80d6b07ba0a28258ab64889b837cbd68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf 2023-09-20 09:02:23,671 DEBUG [StoreOpener-6d755b6bbca94314dd5ddee5fc119f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf 2023-09-20 09:02:23,673 INFO [StoreOpener-80d6b07ba0a28258ab64889b837cbd68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80d6b07ba0a28258ab64889b837cbd68 columnFamilyName cf 2023-09-20 09:02:23,673 INFO [StoreOpener-6d755b6bbca94314dd5ddee5fc119f71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d755b6bbca94314dd5ddee5fc119f71 columnFamilyName cf 2023-09-20 09:02:23,674 INFO [StoreOpener-80d6b07ba0a28258ab64889b837cbd68-1] regionserver.HStore(310): Store=80d6b07ba0a28258ab64889b837cbd68/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:23,674 INFO [StoreOpener-6d755b6bbca94314dd5ddee5fc119f71-1] regionserver.HStore(310): Store=6d755b6bbca94314dd5ddee5fc119f71/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:23,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:23,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:23,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:23,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80d6b07ba0a28258ab64889b837cbd68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69753708, jitterRate=0.03941124677658081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80d6b07ba0a28258ab64889b837cbd68: 2023-09-20 09:02:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:23,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d755b6bbca94314dd5ddee5fc119f71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64240665, jitterRate=-0.042739495635032654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:23,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68., pid=61, masterSystemTime=1695200543661 2023-09-20 09:02:23,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d755b6bbca94314dd5ddee5fc119f71: 2023-09-20 09:02:23,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71., pid=60, masterSystemTime=1695200543660 2023-09-20 09:02:23,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,684 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=80d6b07ba0a28258ab64889b837cbd68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,684 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200543684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200543684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200543684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200543684"}]},"ts":"1695200543684"} 2023-09-20 09:02:23,685 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6d755b6bbca94314dd5ddee5fc119f71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,685 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200543685"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200543685"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200543685"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200543685"}]},"ts":"1695200543685"} 2023-09-20 09:02:23,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-20 09:02:23,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 80d6b07ba0a28258ab64889b837cbd68, server=jenkins-hbase4.apache.org,37597,1695200470915 in 177 msec 2023-09-20 09:02:23,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-20 09:02:23,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 6d755b6bbca94314dd5ddee5fc119f71, server=jenkins-hbase4.apache.org,39705,1695200470965 in 178 msec 2023-09-20 09:02:23,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, ASSIGN in 338 msec 2023-09-20 09:02:23,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-20 09:02:23,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, ASSIGN in 340 msec 2023-09-20 09:02:23,693 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:02:23,693 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200543693"}]},"ts":"1695200543693"} 2023-09-20 09:02:23,694 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-20 09:02:23,696 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:02:23,697 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-20 09:02:23,699 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-20 09:02:23,700 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,700 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,700 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,700 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:23,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:23,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:23,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:23,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:23,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-09-20 09:02:23,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 09:02:23,906 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-20 09:02:23,909 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,909 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,911 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:02:23,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 09:02:23,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200543923 (current time:1695200543923). 2023-09-20 09:02:23,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:23,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x770aa313 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:23,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f85b054, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:23,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:23,933 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x770aa313 to 127.0.0.1:51278 2023-09-20 09:02:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:23,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x22ffaf69 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:23,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cf921e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:23,941 DEBUG [hconnection-0x12da9543-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:23,943 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:23,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:23,949 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22ffaf69 to 127.0.0.1:51278 2023-09-20 09:02:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-20 09:02:23,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:23,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 09:02:23,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 09:02:23,954 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 09:02:23,955 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695201143955 2023-09-20 09:02:23,955 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 09:02:23,956 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:23,956 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:23,957 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 09:02:23,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 09:02:23,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-20 09:02:23,959 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 09:02:23,959 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695201143959 2023-09-20 09:02:23,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,968 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-20 09:02:23,968 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:23,969 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-20 09:02:23,969 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-20 09:02:23,970 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,970 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,972 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:23,972 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:23,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:23,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:23,972 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,972 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:23,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:23,973 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,973 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,973 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,973 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-20 09:02:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 09:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 09:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 09:02:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 09:02:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 09:02:23,974 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 09:02:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:23,976 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 09:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 09:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 09:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 09:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 09:02:23,977 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 09:02:23,978 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,978 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:23,979 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,979 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,979 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,979 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:23,979 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,980 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b68a55[Count = 1] remaining members to acquire global barrier 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:23,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 09:02:23,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b68a55[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:23,983 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-20 09:02:23,983 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 09:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:23,985 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,984 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,985 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. started... 2023-09-20 09:02:23,985 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:23,985 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. started... 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d755b6bbca94314dd5ddee5fc119f71: 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:23,985 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80d6b07ba0a28258ab64889b837cbd68: 2023-09-20 09:02:23,986 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,986 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:23,986 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:02:23,987 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:02:23,991 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 09:02:23,991 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:23,991 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 09:02:23,995 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. completed. 2023-09-20 09:02:23,995 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:23,996 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. completed. 2023-09-20 09:02:23,996 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 09:02:23,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:23,997 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,997 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 09:02:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:23,997 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:23,998 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 09:02:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 09:02:23,999 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:23,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 09:02:24,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:02:24,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-20 09:02:24,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39705,1695200470965': 2023-09-20 09:02:24,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-20 09:02:24,006 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-20 09:02:24,007 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:24,007 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:24,007 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,007 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:24,008 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,008 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,008 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,008 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,009 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,009 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,008 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,009 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,010 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,010 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,012 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,013 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,013 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,016 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,016 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,017 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:02:24,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,018 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,019 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,019 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,019 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,019 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,019 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,019 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 09:02:24,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-20 09:02:24,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,054 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695200543955Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695200544031 (+76 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695200544031Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695200544031Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695200544038 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695200544047 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695200544053 (+6 ms) 2023-09-20 09:02:24,056 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 09:02:24,056 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:24,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 09:02:24,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:24,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 100 msec 2023-09-20 09:02:24,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:02:24,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39705] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:02:24,063 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,063 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:24,064 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:02:24,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 09:02:24,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200544073 (current time:1695200544073). 2023-09-20 09:02:24,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:24,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x720f73f9 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:24,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b3ac414, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:24,084 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:24,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x720f73f9 to 127.0.0.1:51278 2023-09-20 09:02:24,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:24,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x0e5f1b9b to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:24,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c63112, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:24,091 DEBUG [hconnection-0x3ae14f9a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:24,094 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:24,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:24,099 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:24,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e5f1b9b to 127.0.0.1:51278 2023-09-20 09:02:24,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:24,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-20 09:02:24,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:24,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 09:02:24,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 09:02:24,104 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 09:02:24,105 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695201144105 2023-09-20 09:02:24,105 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 09:02:24,106 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:24,106 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:24,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 09:02:24,107 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 09:02:24,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-20 09:02:24,109 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 09:02:24,109 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695201144109 2023-09-20 09:02:24,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,117 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-20 09:02:24,117 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:24,118 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-20 09:02:24,118 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-20 09:02:24,119 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,119 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,120 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,120 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,120 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,120 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,121 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-20 09:02:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,121 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,121 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 09:02:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 09:02:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:24,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,123 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 09:02:24,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,123 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 09:02:24,123 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 09:02:24,123 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:24,123 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 09:02:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 09:02:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 09:02:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 09:02:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 09:02:24,123 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:24,125 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 09:02:24,125 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 09:02:24,125 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 09:02:24,126 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,127 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,127 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,127 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,127 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,127 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,127 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:24,127 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,128 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,127 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:24,128 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 09:02:24,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b99822[Count = 1] remaining members to acquire global barrier 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 09:02:24,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b99822[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:24,131 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-20 09:02:24,131 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,133 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,133 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 09:02:24,134 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,134 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:24,134 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:24,134 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:24,134 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:24,134 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. started... 2023-09-20 09:02:24,134 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. started... 2023-09-20 09:02:24,135 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 80d6b07ba0a28258ab64889b837cbd68 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-20 09:02:24,135 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6d755b6bbca94314dd5ddee5fc119f71 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-20 09:02:24,135 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 09:02:24,135 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:24,135 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 09:02:24,154 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920f248ffb9cbe04796b7a3ac2ab806a90a to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920f248ffb9cbe04796b7a3ac2ab806a90a 2023-09-20 09:02:24,154 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920efec625b8bca4c72bad8aaa5291cd8b5 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920efec625b8bca4c72bad8aaa5291cd8b5 2023-09-20 09:02:24,162 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/.tmp/cf/49419779a2e14fcd8914a4380da188fd 2023-09-20 09:02:24,162 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/.tmp/cf/7f2b9f88874347cf87f5a84d8d86ff58 2023-09-20 09:02:24,167 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/.tmp/cf/7f2b9f88874347cf87f5a84d8d86ff58 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf/7f2b9f88874347cf87f5a84d8d86ff58 2023-09-20 09:02:24,167 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/.tmp/cf/49419779a2e14fcd8914a4380da188fd as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf/49419779a2e14fcd8914a4380da188fd 2023-09-20 09:02:24,172 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf/7f2b9f88874347cf87f5a84d8d86ff58, entries=48, sequenceid=6, filesize=13.7 K 2023-09-20 09:02:24,173 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf/49419779a2e14fcd8914a4380da188fd, entries=2, sequenceid=6, filesize=5.3 K 2023-09-20 09:02:24,174 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 80d6b07ba0a28258ab64889b837cbd68 in 39ms, sequenceid=6, compaction requested=false 2023-09-20 09:02:24,174 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6d755b6bbca94314dd5ddee5fc119f71 in 39ms, sequenceid=6, compaction requested=false 2023-09-20 09:02:24,174 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-20 09:02:24,174 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d755b6bbca94314dd5ddee5fc119f71: 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80d6b07ba0a28258ab64889b837cbd68: 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf/7f2b9f88874347cf87f5a84d8d86ff58] hfiles 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf/7f2b9f88874347cf87f5a84d8d86ff58 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf/49419779a2e14fcd8914a4380da188fd] hfiles 2023-09-20 09:02:24,177 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf/49419779a2e14fcd8914a4380da188fd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,187 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. completed. 2023-09-20 09:02:24,187 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:24,187 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,187 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. completed. 2023-09-20 09:02:24,188 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 09:02:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:24,189 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 09:02:24,189 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,189 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,190 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 09:02:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 09:02:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:24,191 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 09:02:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39705,1695200470965': 2023-09-20 09:02:24,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-20 09:02:24,198 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-20 09:02:24,198 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:24,198 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:24,198 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,198 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,204 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:24,205 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,205 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,206 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,207 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 09:02:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:24,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:02:24,207 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,208 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:02:24,208 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,211 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:24,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:02:24,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,210 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,210 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:24,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,211 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:24,211 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:24,212 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,213 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,213 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,213 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920efec625b8bca4c72bad8aaa5291cd8b5, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920f248ffb9cbe04796b7a3ac2ab806a90a] mob files 2023-09-20 09:02:24,213 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:24,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920efec625b8bca4c72bad8aaa5291cd8b5 2023-09-20 09:02:24,213 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920f248ffb9cbe04796b7a3ac2ab806a90a 2023-09-20 09:02:24,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:24,213 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:24,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-20 09:02:24,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,251 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:24,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695200544105Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695200544220 (+115 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695200544220Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695200544220Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695200544224 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695200544239 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695200544251 (+12 ms) 2023-09-20 09:02:24,254 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 09:02:24,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 148 msec 2023-09-20 09:02:24,408 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:24,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 09:02:24,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:24,436 DEBUG [Listener at jenkins-hbase4.apache.org/32943] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 09:02:24,440 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 09:02:24,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-20 09:02:24,442 DEBUG [Listener at jenkins-hbase4.apache.org/32943] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 09:02:24,446 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 09:02:24,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39705] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-20 09:02:24,447 DEBUG [Listener at jenkins-hbase4.apache.org/32943] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 09:02:24,448 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 09:02:24,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45323] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-20 09:02:24,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-20 09:02:24,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:24,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:02:24,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-20 09:02:24,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:02:24,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 09:02:24,457 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,457 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,457 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 empty. 2023-09-20 09:02:24,457 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 empty. 2023-09-20 09:02:24,458 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,458 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,458 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-20 09:02:24,468 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-20 09:02:24,469 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => db087c8ac068e860efd3b4aaca39b294, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:24,469 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff7e12e5fec6d98e1d6aba1ddf4dd2d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ff7e12e5fec6d98e1d6aba1ddf4dd2d6, disabling compactions & flushes 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing db087c8ac068e860efd3b4aaca39b294, disabling compactions & flushes 2023-09-20 09:02:24,478 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,478 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. after waiting 0 ms 2023-09-20 09:02:24,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. after waiting 0 ms 2023-09-20 09:02:24,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,479 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,479 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ff7e12e5fec6d98e1d6aba1ddf4dd2d6: 2023-09-20 09:02:24,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for db087c8ac068e860efd3b4aaca39b294: 2023-09-20 09:02:24,481 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:02:24,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200544482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200544482"}]},"ts":"1695200544482"} 2023-09-20 09:02:24,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200544482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200544482"}]},"ts":"1695200544482"} 2023-09-20 09:02:24,484 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:02:24,484 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:02:24,484 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200544484"}]},"ts":"1695200544484"} 2023-09-20 09:02:24,485 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-20 09:02:24,488 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:02:24,489 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:02:24,489 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:02:24,489 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:02:24,489 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:02:24,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, ASSIGN}] 2023-09-20 09:02:24,492 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, ASSIGN 2023-09-20 09:02:24,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, ASSIGN 2023-09-20 09:02:24,493 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45323,1695200471000; forceNewPlan=false, retain=false 2023-09-20 09:02:24,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:02:24,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 09:02:24,643 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:02:24,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=db087c8ac068e860efd3b4aaca39b294, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,646 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200544646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200544646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200544646"}]},"ts":"1695200544646"} 2023-09-20 09:02:24,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200544646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200544646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200544646"}]},"ts":"1695200544646"} 2023-09-20 09:02:24,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure ff7e12e5fec6d98e1d6aba1ddf4dd2d6, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:02:24,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure db087c8ac068e860efd3b4aaca39b294, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:24,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 09:02:24,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff7e12e5fec6d98e1d6aba1ddf4dd2d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.', STARTKEY => '2', ENDKEY => ''} 2023-09-20 09:02:24,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db087c8ac068e860efd3b4aaca39b294, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.', STARTKEY => '', ENDKEY => '2'} 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. service=AccessControlService 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. service=AccessControlService 2023-09-20 09:02:24,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:24,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,805 INFO [StoreOpener-db087c8ac068e860efd3b4aaca39b294-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,805 INFO [StoreOpener-ff7e12e5fec6d98e1d6aba1ddf4dd2d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,807 DEBUG [StoreOpener-db087c8ac068e860efd3b4aaca39b294-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf 2023-09-20 09:02:24,807 DEBUG [StoreOpener-db087c8ac068e860efd3b4aaca39b294-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf 2023-09-20 09:02:24,807 DEBUG [StoreOpener-ff7e12e5fec6d98e1d6aba1ddf4dd2d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf 2023-09-20 09:02:24,807 DEBUG [StoreOpener-ff7e12e5fec6d98e1d6aba1ddf4dd2d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf 2023-09-20 09:02:24,807 INFO [StoreOpener-db087c8ac068e860efd3b4aaca39b294-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db087c8ac068e860efd3b4aaca39b294 columnFamilyName cf 2023-09-20 09:02:24,807 INFO [StoreOpener-ff7e12e5fec6d98e1d6aba1ddf4dd2d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff7e12e5fec6d98e1d6aba1ddf4dd2d6 columnFamilyName cf 2023-09-20 09:02:24,808 INFO [StoreOpener-db087c8ac068e860efd3b4aaca39b294-1] regionserver.HStore(310): Store=db087c8ac068e860efd3b4aaca39b294/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:24,808 INFO [StoreOpener-ff7e12e5fec6d98e1d6aba1ddf4dd2d6-1] regionserver.HStore(310): Store=ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:24,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:24,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:24,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:24,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:24,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff7e12e5fec6d98e1d6aba1ddf4dd2d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69180396, jitterRate=0.030868232250213623}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:24,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db087c8ac068e860efd3b4aaca39b294; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68327337, jitterRate=0.018156662583351135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:24,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff7e12e5fec6d98e1d6aba1ddf4dd2d6: 2023-09-20 09:02:24,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db087c8ac068e860efd3b4aaca39b294: 2023-09-20 09:02:24,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6., pid=69, masterSystemTime=1695200544799 2023-09-20 09:02:24,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294., pid=70, masterSystemTime=1695200544800 2023-09-20 09:02:24,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:24,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:24,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:24,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200544817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200544817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200544817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200544817"}]},"ts":"1695200544817"} 2023-09-20 09:02:24,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=db087c8ac068e860efd3b4aaca39b294, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:24,818 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200544817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200544817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200544817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200544817"}]},"ts":"1695200544817"} 2023-09-20 09:02:24,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-20 09:02:24,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure ff7e12e5fec6d98e1d6aba1ddf4dd2d6, server=jenkins-hbase4.apache.org,45323,1695200471000 in 171 msec 2023-09-20 09:02:24,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-20 09:02:24,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure db087c8ac068e860efd3b4aaca39b294, server=jenkins-hbase4.apache.org,37597,1695200470915 in 171 msec 2023-09-20 09:02:24,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, ASSIGN in 331 msec 2023-09-20 09:02:24,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-20 09:02:24,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, ASSIGN in 332 msec 2023-09-20 09:02:24,825 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:02:24,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200544826"}]},"ts":"1695200544826"} 2023-09-20 09:02:24,827 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-20 09:02:24,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:02:24,830 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-20 09:02:24,832 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-20 09:02:24,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:24,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:24,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:24,833 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:24,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 384 msec 2023-09-20 09:02:25,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 09:02:25,058 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-20 09:02:25,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions db087c8ac068e860efd3b4aaca39b294, ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:25,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[db087c8ac068e860efd3b4aaca39b294, ff7e12e5fec6d98e1d6aba1ddf4dd2d6], force=true 2023-09-20 09:02:25,089 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[db087c8ac068e860efd3b4aaca39b294, ff7e12e5fec6d98e1d6aba1ddf4dd2d6], force=true 2023-09-20 09:02:25,089 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[db087c8ac068e860efd3b4aaca39b294, ff7e12e5fec6d98e1d6aba1ddf4dd2d6], force=true 2023-09-20 09:02:25,089 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[db087c8ac068e860efd3b4aaca39b294, ff7e12e5fec6d98e1d6aba1ddf4dd2d6], force=true 2023-09-20 09:02:25,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 09:02:25,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, UNASSIGN}] 2023-09-20 09:02:25,112 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, UNASSIGN 2023-09-20 09:02:25,112 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, UNASSIGN 2023-09-20 09:02:25,113 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=db087c8ac068e860efd3b4aaca39b294, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:25,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:25,113 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200545113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200545113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200545113"}]},"ts":"1695200545113"} 2023-09-20 09:02:25,113 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200545113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200545113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200545113"}]},"ts":"1695200545113"} 2023-09-20 09:02:25,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure db087c8ac068e860efd3b4aaca39b294, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:25,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ff7e12e5fec6d98e1d6aba1ddf4dd2d6, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:02:25,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 09:02:25,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:25,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:25,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff7e12e5fec6d98e1d6aba1ddf4dd2d6, disabling compactions & flushes 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db087c8ac068e860efd3b4aaca39b294, disabling compactions & flushes 2023-09-20 09:02:25,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:25,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. after waiting 0 ms 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. after waiting 0 ms 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:25,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing db087c8ac068e860efd3b4aaca39b294 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-20 09:02:25,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ff7e12e5fec6d98e1d6aba1ddf4dd2d6 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-20 09:02:25,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/.tmp/cf/c2cdced3878c4f11b3928efa0e451345 2023-09-20 09:02:25,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/.tmp/cf/fca7e59a27254af28f7df35a137a8d2c 2023-09-20 09:02:25,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/.tmp/cf/c2cdced3878c4f11b3928efa0e451345 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf/c2cdced3878c4f11b3928efa0e451345 2023-09-20 09:02:25,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/.tmp/cf/fca7e59a27254af28f7df35a137a8d2c as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf/fca7e59a27254af28f7df35a137a8d2c 2023-09-20 09:02:25,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf/fca7e59a27254af28f7df35a137a8d2c, entries=1, sequenceid=5, filesize=4.7 K 2023-09-20 09:02:25,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf/c2cdced3878c4f11b3928efa0e451345, entries=1, sequenceid=5, filesize=4.7 K 2023-09-20 09:02:25,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for db087c8ac068e860efd3b4aaca39b294 in 24ms, sequenceid=5, compaction requested=false 2023-09-20 09:02:25,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ff7e12e5fec6d98e1d6aba1ddf4dd2d6 in 24ms, sequenceid=5, compaction requested=false 2023-09-20 09:02:25,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-20 09:02:25,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-20 09:02:25,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-20 09:02:25,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-20 09:02:25,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:25,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:25,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6. 2023-09-20 09:02:25,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294. 2023-09-20 09:02:25,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff7e12e5fec6d98e1d6aba1ddf4dd2d6: 2023-09-20 09:02:25,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db087c8ac068e860efd3b4aaca39b294: 2023-09-20 09:02:25,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:25,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, regionState=CLOSED 2023-09-20 09:02:25,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200545305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200545305"}]},"ts":"1695200545305"} 2023-09-20 09:02:25,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:25,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=db087c8ac068e860efd3b4aaca39b294, regionState=CLOSED 2023-09-20 09:02:25,306 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695200545306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200545306"}]},"ts":"1695200545306"} 2023-09-20 09:02:25,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-20 09:02:25,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ff7e12e5fec6d98e1d6aba1ddf4dd2d6, server=jenkins-hbase4.apache.org,45323,1695200471000 in 192 msec 2023-09-20 09:02:25,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-20 09:02:25,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure db087c8ac068e860efd3b4aaca39b294, server=jenkins-hbase4.apache.org,37597,1695200470915 in 193 msec 2023-09-20 09:02:25,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff7e12e5fec6d98e1d6aba1ddf4dd2d6, UNASSIGN in 201 msec 2023-09-20 09:02:25,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-20 09:02:25,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db087c8ac068e860efd3b4aaca39b294, UNASSIGN in 204 msec 2023-09-20 09:02:25,357 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-20 09:02:25,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544450.db087c8ac068e860efd3b4aaca39b294.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:25,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695200544450.ff7e12e5fec6d98e1d6aba1ddf4dd2d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:25,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:25,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 09:02:25,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, ASSIGN}] 2023-09-20 09:02:25,409 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, ASSIGN 2023-09-20 09:02:25,410 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:02:25,560 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-20 09:02:25,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0a808ce3a030f0bfd811ba564a1cbf5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:25,562 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695200545562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200545562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200545562"}]},"ts":"1695200545562"} 2023-09-20 09:02:25,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0a808ce3a030f0bfd811ba564a1cbf5b, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:25,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 09:02:25,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a808ce3a030f0bfd811ba564a1cbf5b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.', STARTKEY => '', ENDKEY => ''} 2023-09-20 09:02:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. service=AccessControlService 2023-09-20 09:02:25,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/.regioninfo 2023-09-20 09:02:25,728 INFO [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,729 DEBUG [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf 2023-09-20 09:02:25,729 DEBUG [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf 2023-09-20 09:02:25,729 INFO [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a808ce3a030f0bfd811ba564a1cbf5b columnFamilyName cf 2023-09-20 09:02:25,756 DEBUG [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] regionserver.HStore(539): loaded hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/c2cdced3878c4f11b3928efa0e451345.db087c8ac068e860efd3b4aaca39b294->hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf/c2cdced3878c4f11b3928efa0e451345-top 2023-09-20 09:02:25,761 DEBUG [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] regionserver.HStore(539): loaded hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/fca7e59a27254af28f7df35a137a8d2c.ff7e12e5fec6d98e1d6aba1ddf4dd2d6->hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf/fca7e59a27254af28f7df35a137a8d2c-top 2023-09-20 09:02:25,762 INFO [StoreOpener-0a808ce3a030f0bfd811ba564a1cbf5b-1] regionserver.HStore(310): Store=0a808ce3a030f0bfd811ba564a1cbf5b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:25,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:25,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a808ce3a030f0bfd811ba564a1cbf5b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69743910, jitterRate=0.03926524519920349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:25,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a808ce3a030f0bfd811ba564a1cbf5b: 2023-09-20 09:02:25,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b., pid=77, masterSystemTime=1695200545715 2023-09-20 09:02:25,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.,because compaction is disabled. 2023-09-20 09:02:25,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:25,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:25,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0a808ce3a030f0bfd811ba564a1cbf5b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:25,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695200545770"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200545770"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200545770"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200545770"}]},"ts":"1695200545770"} 2023-09-20 09:02:25,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-20 09:02:25,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0a808ce3a030f0bfd811ba564a1cbf5b, server=jenkins-hbase4.apache.org,37597,1695200470915 in 207 msec 2023-09-20 09:02:25,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-20 09:02:25,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, ASSIGN in 365 msec 2023-09-20 09:02:25,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[db087c8ac068e860efd3b4aaca39b294, ff7e12e5fec6d98e1d6aba1ddf4dd2d6], force=true in 693 msec 2023-09-20 09:02:26,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 09:02:26,196 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-20 09:02:26,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-20 09:02:26,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200546197 (current time:1695200546197). 2023-09-20 09:02:26,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:26,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x786b0129 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:26,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59ee5786, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:26,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:26,207 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:26,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x786b0129 to 127.0.0.1:51278 2023-09-20 09:02:26,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:26,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x1a59084e to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:26,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a9b3065, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:26,215 DEBUG [hconnection-0x116202d7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:26,217 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:26,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:26,223 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a59084e to 127.0.0.1:51278 2023-09-20 09:02:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-20 09:02:26,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:26,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-20 09:02:26,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-20 09:02:26,228 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-20 09:02:26,228 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695201146228 2023-09-20 09:02:26,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-20 09:02:26,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,232 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:26,232 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:26,233 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-20 09:02:26,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-20 09:02:26,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-20 09:02:26,234 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-20 09:02:26,235 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695201146235 2023-09-20 09:02:26,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,245 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-20 09:02:26,245 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:26,246 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-20 09:02:26,246 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-20 09:02:26,246 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,246 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,248 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:26,248 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:26,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:26,248 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:26,248 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:26,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:26,249 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,249 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-20 09:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-20 09:02:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-20 09:02:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:26,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-20 09:02:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-20 09:02:26,251 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-20 09:02:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-20 09:02:26,253 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-20 09:02:26,253 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-20 09:02:26,253 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-20 09:02:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-20 09:02:26,253 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-20 09:02:26,253 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-20 09:02:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,258 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:26,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-20 09:02:26,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23368f06[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:26,260 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-20 09:02:26,261 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-20 09:02:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,262 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:26,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,262 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-20 09:02:26,263 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-20 09:02:26,263 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-20 09:02:26,263 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:26,262 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-20 09:02:26,263 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:26,263 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:26,263 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:26,263 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:26,263 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. started... 2023-09-20 09:02:26,264 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a808ce3a030f0bfd811ba564a1cbf5b: 2023-09-20 09:02:26,264 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,265 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:26,265 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/c2cdced3878c4f11b3928efa0e451345.db087c8ac068e860efd3b4aaca39b294->hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf/c2cdced3878c4f11b3928efa0e451345-top, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/fca7e59a27254af28f7df35a137a8d2c.ff7e12e5fec6d98e1d6aba1ddf4dd2d6->hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf/fca7e59a27254af28f7df35a137a8d2c-top] hfiles 2023-09-20 09:02:26,265 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/c2cdced3878c4f11b3928efa0e451345.db087c8ac068e860efd3b4aaca39b294 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,265 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-20 09:02:26,265 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/fca7e59a27254af28f7df35a137a8d2c.ff7e12e5fec6d98e1d6aba1ddf4dd2d6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,265 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:26,265 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-20 09:02:26,266 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-20 09:02:26,266 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:26,267 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-20 09:02:26,277 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. completed. 2023-09-20 09:02:26,277 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:26,277 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:26,277 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:26,277 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,277 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-20 09:02:26,277 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:26,282 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-20 09:02:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-20 09:02:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:02:26,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-20 09:02:26,285 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-20 09:02:26,286 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:26,286 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:26,286 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,286 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:26,287 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,287 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,287 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:26,287 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,287 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:26,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:26,287 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:26,288 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,288 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:26,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,288 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:26,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:26,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:26,289 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,292 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,293 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,293 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:26,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,300 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:26,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:26,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:26,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-09-20 09:02:26,300 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:26,300 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:26,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:26,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:26,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:26,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:26,301 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,301 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,302 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:26,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:26,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:26,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-20 09:02:26,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,326 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695200546229Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695200546301 (+72 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695200546301Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695200546306 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695200546317 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695200546325 (+8 ms) 2023-09-20 09:02:26,329 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-20 09:02:26,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 97 msec 2023-09-20 09:02:26,332 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:26,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-20 09:02:26,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:26,333 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333 2023-09-20 09:02:26,333 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33191, tgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333, rawTgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:26,355 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:26,355 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1372398971_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,355 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-20 09:02:26,363 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:26,381 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:26,381 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:26,382 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:26,382 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:26,950 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0004_000001 (auth:SIMPLE) 2023-09-20 09:02:27,261 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-2789424498502931222.jar 2023-09-20 09:02:27,262 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,262 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,328 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-8925426285025222787.jar 2023-09-20 09:02:27,329 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,329 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,330 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,330 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,330 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,331 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:27,331 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:02:27,332 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:02:27,332 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:02:27,332 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:02:27,332 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:02:27,333 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:02:27,333 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:02:27,334 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:02:27,334 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:02:27,334 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:02:27,335 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:27,335 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:27,336 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:27,336 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:27,336 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:27,337 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:27,337 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:27,674 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:02:27,676 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-20 09:02:27,678 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-20 09:02:27,730 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:27,730 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:27,953 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0005_000001 (auth:SIMPLE) 2023-09-20 09:02:28,590 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:02:31,686 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0005_000001 (auth:SIMPLE) 2023-09-20 09:02:33,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0005_000001 (auth:SIMPLE) 2023-09-20 09:02:36,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0005_000001 (auth:SIMPLE) 2023-09-20 09:02:37,888 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:02:37,891 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:02:37,899 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:37,900 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:02:37,900 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:02:37,900 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:37,901 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-20 09:02:37,901 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-20 09:02:37,901 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:37,901 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-20 09:02:37,901 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200546333/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-20 09:02:37,907 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:37,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:37,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:37,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-20 09:02:37,912 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200557912"}]},"ts":"1695200557912"} 2023-09-20 09:02:37,914 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-20 09:02:37,915 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-20 09:02:37,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, UNASSIGN}] 2023-09-20 09:02:37,918 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, UNASSIGN 2023-09-20 09:02:37,918 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0a808ce3a030f0bfd811ba564a1cbf5b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:37,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695200557918"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200557918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200557918"}]},"ts":"1695200557918"} 2023-09-20 09:02:37,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0a808ce3a030f0bfd811ba564a1cbf5b, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:38,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-20 09:02:38,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:38,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a808ce3a030f0bfd811ba564a1cbf5b, disabling compactions & flushes 2023-09-20 09:02:38,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:38,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:38,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. after waiting 0 ms 2023-09-20 09:02:38,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:38,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-20 09:02:38,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:38,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b. 2023-09-20 09:02:38,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a808ce3a030f0bfd811ba564a1cbf5b: 2023-09-20 09:02:38,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:38,088 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0a808ce3a030f0bfd811ba564a1cbf5b, regionState=CLOSED 2023-09-20 09:02:38,088 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695200558088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200558088"}]},"ts":"1695200558088"} 2023-09-20 09:02:38,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-20 09:02:38,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0a808ce3a030f0bfd811ba564a1cbf5b, server=jenkins-hbase4.apache.org,37597,1695200470915 in 170 msec 2023-09-20 09:02:38,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-20 09:02:38,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a808ce3a030f0bfd811ba564a1cbf5b, UNASSIGN in 175 msec 2023-09-20 09:02:38,093 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200558093"}]},"ts":"1695200558093"} 2023-09-20 09:02:38,094 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-20 09:02:38,095 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-20 09:02:38,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-09-20 09:02:38,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-20 09:02:38,214 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-20 09:02:38,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,218 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,220 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:38,223 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:38,223 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:38,223 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,223 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,223 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,223 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 09:02:38,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 09:02:38,225 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/recovered.edits] 2023-09-20 09:02:38,225 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/recovered.edits] 2023-09-20 09:02:38,225 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/recovered.edits] 2023-09-20 09:02:38,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 09:02:38,225 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 09:02:38,225 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,226 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,226 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,226 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:38,226 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:38,226 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,227 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-20 09:02:38,227 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:38,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:38,230 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf/c2cdced3878c4f11b3928efa0e451345 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/cf/c2cdced3878c4f11b3928efa0e451345 2023-09-20 09:02:38,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf/fca7e59a27254af28f7df35a137a8d2c to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/cf/fca7e59a27254af28f7df35a137a8d2c 2023-09-20 09:02:38,231 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/c2cdced3878c4f11b3928efa0e451345.db087c8ac068e860efd3b4aaca39b294 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/c2cdced3878c4f11b3928efa0e451345.db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:38,232 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/fca7e59a27254af28f7df35a137a8d2c.ff7e12e5fec6d98e1d6aba1ddf4dd2d6 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/cf/fca7e59a27254af28f7df35a137a8d2c.ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:38,234 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/recovered.edits/8.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294/recovered.edits/8.seqid 2023-09-20 09:02:38,235 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/recovered.edits/8.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6/recovered.edits/8.seqid 2023-09-20 09:02:38,235 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db087c8ac068e860efd3b4aaca39b294 2023-09-20 09:02:38,235 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff7e12e5fec6d98e1d6aba1ddf4dd2d6 2023-09-20 09:02:38,236 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/recovered.edits/12.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b/recovered.edits/12.seqid 2023-09-20 09:02:38,236 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a808ce3a030f0bfd811ba564a1cbf5b 2023-09-20 09:02:38,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-20 09:02:38,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,241 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-20 09:02:38,243 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-20 09:02:38,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-20 09:02:38,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200558244"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:38,245 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-20 09:02:38,246 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a808ce3a030f0bfd811ba564a1cbf5b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695200544451.0a808ce3a030f0bfd811ba564a1cbf5b.', STARTKEY => '', ENDKEY => ''}] 2023-09-20 09:02:38,246 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-20 09:02:38,246 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200558246"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:38,251 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-20 09:02:38,253 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 38 msec 2023-09-20 09:02:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-20 09:02:38,329 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-20 09:02:38,329 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-20 09:02:38,333 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200558333"}]},"ts":"1695200558333"} 2023-09-20 09:02:38,335 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-20 09:02:38,336 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-20 09:02:38,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, UNASSIGN}] 2023-09-20 09:02:38,339 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, UNASSIGN 2023-09-20 09:02:38,339 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, UNASSIGN 2023-09-20 09:02:38,340 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=80d6b07ba0a28258ab64889b837cbd68, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:38,340 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6d755b6bbca94314dd5ddee5fc119f71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:38,340 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200558340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200558340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200558340"}]},"ts":"1695200558340"} 2023-09-20 09:02:38,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200558340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200558340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200558340"}]},"ts":"1695200558340"} 2023-09-20 09:02:38,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 80d6b07ba0a28258ab64889b837cbd68, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:38,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 6d755b6bbca94314dd5ddee5fc119f71, server=jenkins-hbase4.apache.org,39705,1695200470965}] 2023-09-20 09:02:38,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-20 09:02:38,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:38,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:38,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80d6b07ba0a28258ab64889b837cbd68, disabling compactions & flushes 2023-09-20 09:02:38,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d755b6bbca94314dd5ddee5fc119f71, disabling compactions & flushes 2023-09-20 09:02:38,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:38,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:38,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:38,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:38,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. after waiting 0 ms 2023-09-20 09:02:38,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:38,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. after waiting 0 ms 2023-09-20 09:02:38,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:38,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:02:38,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:02:38,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:38,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:38,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68. 2023-09-20 09:02:38,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71. 2023-09-20 09:02:38,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80d6b07ba0a28258ab64889b837cbd68: 2023-09-20 09:02:38,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d755b6bbca94314dd5ddee5fc119f71: 2023-09-20 09:02:38,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:38,511 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=80d6b07ba0a28258ab64889b837cbd68, regionState=CLOSED 2023-09-20 09:02:38,512 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200558511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200558511"}]},"ts":"1695200558511"} 2023-09-20 09:02:38,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:38,512 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6d755b6bbca94314dd5ddee5fc119f71, regionState=CLOSED 2023-09-20 09:02:38,512 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695200558512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200558512"}]},"ts":"1695200558512"} 2023-09-20 09:02:38,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-20 09:02:38,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 80d6b07ba0a28258ab64889b837cbd68, server=jenkins-hbase4.apache.org,37597,1695200470915 in 172 msec 2023-09-20 09:02:38,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-20 09:02:38,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 6d755b6bbca94314dd5ddee5fc119f71, server=jenkins-hbase4.apache.org,39705,1695200470965 in 172 msec 2023-09-20 09:02:38,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80d6b07ba0a28258ab64889b837cbd68, UNASSIGN in 178 msec 2023-09-20 09:02:38,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-20 09:02:38,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6d755b6bbca94314dd5ddee5fc119f71, UNASSIGN in 178 msec 2023-09-20 09:02:38,517 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200558517"}]},"ts":"1695200558517"} 2023-09-20 09:02:38,518 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-20 09:02:38,520 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-20 09:02:38,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-09-20 09:02:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-20 09:02:38,635 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-20 09:02:38,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,639 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,640 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,641 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,643 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,643 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,643 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,643 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,644 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:38,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 09:02:38,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 09:02:38,644 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:38,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 09:02:38,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,645 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-20 09:02:38,646 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/recovered.edits] 2023-09-20 09:02:38,647 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/recovered.edits] 2023-09-20 09:02:38,650 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf/49419779a2e14fcd8914a4380da188fd to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/cf/49419779a2e14fcd8914a4380da188fd 2023-09-20 09:02:38,650 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf/7f2b9f88874347cf87f5a84d8d86ff58 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/cf/7f2b9f88874347cf87f5a84d8d86ff58 2023-09-20 09:02:38,653 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68/recovered.edits/9.seqid 2023-09-20 09:02:38,653 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71/recovered.edits/9.seqid 2023-09-20 09:02:38,654 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80d6b07ba0a28258ab64889b837cbd68 2023-09-20 09:02:38,654 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6d755b6bbca94314dd5ddee5fc119f71 2023-09-20 09:02:38,654 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-20 09:02:38,654 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-20 09:02:38,655 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-20 09:02:38,658 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920efec625b8bca4c72bad8aaa5291cd8b5 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920efec625b8bca4c72bad8aaa5291cd8b5 2023-09-20 09:02:38,659 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920f248ffb9cbe04796b7a3ac2ab806a90a to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920f248ffb9cbe04796b7a3ac2ab806a90a 2023-09-20 09:02:38,659 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-20 09:02:38,661 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,663 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-20 09:02:38,665 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-20 09:02:38,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-20 09:02:38,666 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200558666"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:38,666 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200558666"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:38,667 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 09:02:38,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 80d6b07ba0a28258ab64889b837cbd68, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695200543298.80d6b07ba0a28258ab64889b837cbd68.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6d755b6bbca94314dd5ddee5fc119f71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695200543298.6d755b6bbca94314dd5ddee5fc119f71.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 09:02:38,667 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-20 09:02:38,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200558667"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:38,669 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-20 09:02:38,672 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-20 09:02:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-20 09:02:38,747 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-20 09:02:38,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-20 09:02:38,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-20 09:02:38,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 09:02:38,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-20 09:02:38,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 09:02:38,786 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 745) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_700879559_1 at /127.0.0.1:41916 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3958 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:36964 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:38737 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x516761b2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:50232 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:50220 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_700879559_1 at /127.0.0.1:36922 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:41932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=11579 (was 11642) 2023-09-20 09:02:38,787 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-20 09:02:38,806 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=168, AvailableMemoryMB=11578 2023-09-20 09:02:38,806 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-20 09:02:38,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 09:02:38,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:38,810 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:02:38,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-20 09:02:38,811 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:02:38,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 09:02:38,813 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:38,813 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:38,813 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 empty. 2023-09-20 09:02:38,813 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 empty. 2023-09-20 09:02:38,814 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:38,814 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:38,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-20 09:02:38,822 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-20 09:02:38,823 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0468f695d4d4b6993b086f3e0d6360b0, NAME => 'testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:38,823 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => dda3f8afe3bb1e4304a6a060364be813, NAME => 'testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing dda3f8afe3bb1e4304a6a060364be813, disabling compactions & flushes 2023-09-20 09:02:38,831 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0468f695d4d4b6993b086f3e0d6360b0, disabling compactions & flushes 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. after waiting 0 ms 2023-09-20 09:02:38,831 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:38,831 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:38,832 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:38,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:38,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for dda3f8afe3bb1e4304a6a060364be813: 2023-09-20 09:02:38,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. after waiting 0 ms 2023-09-20 09:02:38,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:38,832 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:38,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0468f695d4d4b6993b086f3e0d6360b0: 2023-09-20 09:02:38,833 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:02:38,834 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200558834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200558834"}]},"ts":"1695200558834"} 2023-09-20 09:02:38,834 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200558834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200558834"}]},"ts":"1695200558834"} 2023-09-20 09:02:38,836 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:02:38,837 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:02:38,837 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200558837"}]},"ts":"1695200558837"} 2023-09-20 09:02:38,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-20 09:02:38,841 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:02:38,842 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:02:38,842 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:02:38,842 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:02:38,842 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:02:38,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, ASSIGN}] 2023-09-20 09:02:38,845 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, ASSIGN 2023-09-20 09:02:38,845 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, ASSIGN 2023-09-20 09:02:38,846 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45323,1695200471000; forceNewPlan=false, retain=false 2023-09-20 09:02:38,846 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37597,1695200470915; forceNewPlan=false, retain=false 2023-09-20 09:02:38,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 09:02:38,996 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:02:38,999 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dda3f8afe3bb1e4304a6a060364be813, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:38,999 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0468f695d4d4b6993b086f3e0d6360b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:38,999 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200558999"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200558999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200558999"}]},"ts":"1695200558999"} 2023-09-20 09:02:38,999 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200558999"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200558999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200558999"}]},"ts":"1695200558999"} 2023-09-20 09:02:39,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure dda3f8afe3bb1e4304a6a060364be813, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:02:39,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0468f695d4d4b6993b086f3e0d6360b0, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:39,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 09:02:39,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0468f695d4d4b6993b086f3e0d6360b0, NAME => 'testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dda3f8afe3bb1e4304a6a060364be813, NAME => 'testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. service=AccessControlService 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. service=AccessControlService 2023-09-20 09:02:39,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:39,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,160 INFO [StoreOpener-dda3f8afe3bb1e4304a6a060364be813-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,160 INFO [StoreOpener-0468f695d4d4b6993b086f3e0d6360b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,161 DEBUG [StoreOpener-dda3f8afe3bb1e4304a6a060364be813-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf 2023-09-20 09:02:39,161 DEBUG [StoreOpener-dda3f8afe3bb1e4304a6a060364be813-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf 2023-09-20 09:02:39,161 DEBUG [StoreOpener-0468f695d4d4b6993b086f3e0d6360b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf 2023-09-20 09:02:39,161 DEBUG [StoreOpener-0468f695d4d4b6993b086f3e0d6360b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf 2023-09-20 09:02:39,161 INFO [StoreOpener-dda3f8afe3bb1e4304a6a060364be813-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dda3f8afe3bb1e4304a6a060364be813 columnFamilyName cf 2023-09-20 09:02:39,161 INFO [StoreOpener-0468f695d4d4b6993b086f3e0d6360b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0468f695d4d4b6993b086f3e0d6360b0 columnFamilyName cf 2023-09-20 09:02:39,163 INFO [StoreOpener-dda3f8afe3bb1e4304a6a060364be813-1] regionserver.HStore(310): Store=dda3f8afe3bb1e4304a6a060364be813/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:39,163 INFO [StoreOpener-0468f695d4d4b6993b086f3e0d6360b0-1] regionserver.HStore(310): Store=0468f695d4d4b6993b086f3e0d6360b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:39,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:39,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:39,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:39,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0468f695d4d4b6993b086f3e0d6360b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62431012, jitterRate=-0.06970542669296265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:39,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0468f695d4d4b6993b086f3e0d6360b0: 2023-09-20 09:02:39,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:39,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dda3f8afe3bb1e4304a6a060364be813; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69097224, jitterRate=0.029628872871398926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:39,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dda3f8afe3bb1e4304a6a060364be813: 2023-09-20 09:02:39,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0., pid=94, masterSystemTime=1695200559152 2023-09-20 09:02:39,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813., pid=93, masterSystemTime=1695200559152 2023-09-20 09:02:39,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0468f695d4d4b6993b086f3e0d6360b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200559172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200559172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200559172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200559172"}]},"ts":"1695200559172"} 2023-09-20 09:02:39,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,173 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dda3f8afe3bb1e4304a6a060364be813, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,173 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200559173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200559173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200559173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200559173"}]},"ts":"1695200559173"} 2023-09-20 09:02:39,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-20 09:02:39,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0468f695d4d4b6993b086f3e0d6360b0, server=jenkins-hbase4.apache.org,37597,1695200470915 in 173 msec 2023-09-20 09:02:39,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-20 09:02:39,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure dda3f8afe3bb1e4304a6a060364be813, server=jenkins-hbase4.apache.org,45323,1695200471000 in 174 msec 2023-09-20 09:02:39,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, ASSIGN in 332 msec 2023-09-20 09:02:39,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-20 09:02:39,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, ASSIGN in 333 msec 2023-09-20 09:02:39,178 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:02:39,178 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200559178"}]},"ts":"1695200559178"} 2023-09-20 09:02:39,179 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-20 09:02:39,181 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:02:39,181 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-20 09:02:39,182 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 09:02:39,185 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:39,185 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:39,185 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:39,185 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:39,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:39,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:39,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:39,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:39,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 379 msec 2023-09-20 09:02:39,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 09:02:39,414 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-20 09:02:39,416 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:39,416 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,418 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:02:39,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:02:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200559429 (current time:1695200559429). 2023-09-20 09:02:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x75acc952 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:39,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a98f77f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:39,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:39,443 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:39,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75acc952 to 127.0.0.1:51278 2023-09-20 09:02:39,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:39,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x10b092f9 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:39,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c52fe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:39,452 DEBUG [hconnection-0x4e2b13ec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:39,453 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:39,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:39,459 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:39,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10b092f9 to 127.0.0.1:51278 2023-09-20 09:02:39,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:39,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 09:02:39,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:39,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:02:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:02:39,464 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:02:39,465 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695201159465 2023-09-20 09:02:39,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:02:39,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:39,466 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:39,466 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:39,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 09:02:39,467 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:02:39,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-20 09:02:39,471 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 09:02:39,471 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695201159471 2023-09-20 09:02:39,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,481 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-20 09:02:39,481 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,482 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-20 09:02:39,482 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-20 09:02:39,483 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,483 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,491 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,491 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,491 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,491 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,491 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,491 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,492 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 09:02:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 09:02:39,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 09:02:39,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 09:02:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 09:02:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 09:02:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 09:02:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 09:02:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 09:02:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 09:02:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 09:02:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 09:02:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 09:02:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 09:02:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 09:02:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,498 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:39,500 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@265e3d3e[Count = 1] remaining members to acquire global barrier 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 09:02:39,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@265e3d3e[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:39,504 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 09:02:39,505 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:02:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:39,507 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:39,507 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 09:02:39,507 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. started... 2023-09-20 09:02:39,507 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,508 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:39,507 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. started... 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:39,508 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0468f695d4d4b6993b086f3e0d6360b0: 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dda3f8afe3bb1e4304a6a060364be813: 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:02:39,509 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:02:39,511 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 09:02:39,511 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,511 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 09:02:39,518 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. completed. 2023-09-20 09:02:39,518 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. completed. 2023-09-20 09:02:39,518 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 09:02:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:39,520 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 09:02:39,520 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,520 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,520 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,520 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 09:02:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,520 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 09:02:39,521 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,521 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 09:02:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:02:39,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 09:02:39,528 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-20 09:02:39,528 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:39,528 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:39,528 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,528 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,530 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,529 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,530 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,531 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,532 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,533 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,533 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,541 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,541 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,542 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:39,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,542 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,542 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:02:39,543 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,543 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,543 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,543 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 09:02:39,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,566 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:39,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:02:39,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:02:39,567 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:02:39,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-20 09:02:39,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,571 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695200559465Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695200559551 (+86 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695200559551Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695200559551Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695200559554 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695200559565 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695200559571 (+6 ms) 2023-09-20 09:02:39,574 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 09:02:39,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 108 msec 2023-09-20 09:02:39,767 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:39,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:02:39,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:39,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:02:39,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45323] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:02:39,775 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:39,775 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,776 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:02:39,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:02:39,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200559785 (current time:1695200559785). 2023-09-20 09:02:39,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:39,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x5324bfae to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:39,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26feec40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:39,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:39,794 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:39,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5324bfae to 127.0.0.1:51278 2023-09-20 09:02:39,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:39,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x265f7655 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:39,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50f064ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:39,801 DEBUG [hconnection-0x1bd1e4d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:39,804 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:39,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:39,808 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:39,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x265f7655 to 127.0.0.1:51278 2023-09-20 09:02:39,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:39,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 09:02:39,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:39,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:02:39,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:02:39,812 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:02:39,813 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695201159813 2023-09-20 09:02:39,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 09:02:39,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:39,814 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:39,814 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:39,815 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 09:02:39,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 09:02:39,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-20 09:02:39,817 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 09:02:39,817 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695201159817 2023-09-20 09:02:39,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,826 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-20 09:02:39,826 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,827 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-20 09:02:39,827 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-20 09:02:39,828 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,828 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,829 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,829 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,829 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,829 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,830 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,830 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,830 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,830 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 09:02:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 09:02:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 09:02:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 09:02:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 09:02:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 09:02:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 09:02:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 09:02:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 09:02:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 09:02:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 09:02:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 09:02:39,839 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,839 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,840 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,842 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,842 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3428ff82[Count = 1] remaining members to acquire global barrier 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 09:02:39,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3428ff82[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:39,846 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 09:02:39,846 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,849 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:02:39,849 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:02:39,849 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 09:02:39,849 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:39,849 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,850 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:39,850 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:39,850 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,850 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. started... 2023-09-20 09:02:39,850 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 09:02:39,850 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,850 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:39,850 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:39,850 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:39,850 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,850 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0468f695d4d4b6993b086f3e0d6360b0 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-20 09:02:39,850 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. started... 2023-09-20 09:02:39,850 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dda3f8afe3bb1e4304a6a060364be813 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-20 09:02:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 09:02:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 09:02:39,872 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309200b28b9c540d44b8280e1b1848b4d2aa1 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309200b28b9c540d44b8280e1b1848b4d2aa1 2023-09-20 09:02:39,872 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920c0d6a4398b2444009c0b2df723056e78 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230920c0d6a4398b2444009c0b2df723056e78 2023-09-20 09:02:39,879 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/.tmp/cf/e4557e6bd192444e888b9d749d27280c 2023-09-20 09:02:39,880 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/.tmp/cf/b4d550a2696b4489b83efa1b3b19bc25 2023-09-20 09:02:39,884 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/.tmp/cf/e4557e6bd192444e888b9d749d27280c as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf/e4557e6bd192444e888b9d749d27280c 2023-09-20 09:02:39,886 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/.tmp/cf/b4d550a2696b4489b83efa1b3b19bc25 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf/b4d550a2696b4489b83efa1b3b19bc25 2023-09-20 09:02:39,890 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf/e4557e6bd192444e888b9d749d27280c, entries=4, sequenceid=6, filesize=5.6 K 2023-09-20 09:02:39,890 INFO [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0468f695d4d4b6993b086f3e0d6360b0 in 40ms, sequenceid=6, compaction requested=false 2023-09-20 09:02:39,890 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf/b4d550a2696b4489b83efa1b3b19bc25, entries=46, sequenceid=6, filesize=12.9 K 2023-09-20 09:02:39,891 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-20 09:02:39,891 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for dda3f8afe3bb1e4304a6a060364be813 in 41ms, sequenceid=6, compaction requested=false 2023-09-20 09:02:39,891 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0468f695d4d4b6993b086f3e0d6360b0: 2023-09-20 09:02:39,893 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dda3f8afe3bb1e4304a6a060364be813: 2023-09-20 09:02:39,893 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,893 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,893 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:39,894 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:39,894 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf/b4d550a2696b4489b83efa1b3b19bc25] hfiles 2023-09-20 09:02:39,894 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf/e4557e6bd192444e888b9d749d27280c] hfiles 2023-09-20 09:02:39,894 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf/b4d550a2696b4489b83efa1b3b19bc25 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,894 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf/e4557e6bd192444e888b9d749d27280c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,902 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. completed. 2023-09-20 09:02:39,902 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:39,902 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:39,902 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. completed. 2023-09-20 09:02:39,902 DEBUG [rs(jenkins-hbase4.apache.org,37597,1695200470915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:39,902 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:39,902 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:39,902 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 09:02:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 09:02:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:39,904 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 09:02:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,905 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,905 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 09:02:39,906 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 09:02:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 09:02:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37597,1695200470915': 2023-09-20 09:02:39,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 09:02:39,912 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-20 09:02:39,912 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:39,912 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:39,912 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,912 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:39,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,914 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:02:39,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:02:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,915 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,916 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:02:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,916 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:39,918 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,918 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,919 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:39,922 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:39,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,922 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:39,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:39,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,921 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:39,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:39,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:39,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:39,923 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,924 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230920c0d6a4398b2444009c0b2df723056e78, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309200b28b9c540d44b8280e1b1848b4d2aa1] mob files 2023-09-20 09:02:39,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230920c0d6a4398b2444009c0b2df723056e78 2023-09-20 09:02:39,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309200b28b9c540d44b8280e1b1848b4d2aa1 2023-09-20 09:02:39,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-20 09:02:39,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:39,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695200559813Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695200559935 (+122 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695200559935Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695200559935Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695200559941 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695200559958 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695200559965 (+7 ms) 2023-09-20 09:02:39,970 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 09:02:39,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 156 msec 2023-09-20 09:02:40,116 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 09:02:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:40,117 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117 2023-09-20 09:02:40,117 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33191, tgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117, rawTgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:40,139 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:40,139 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_504242285_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:40,139 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-20 09:02:40,170 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:40,188 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:40,188 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:40,189 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:40,189 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,057 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-3930288082706707507.jar 2023-09-20 09:02:41,058 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,058 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,124 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-885107412466865211.jar 2023-09-20 09:02:41,125 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,125 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,125 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,126 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,126 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,126 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:41,127 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:02:41,127 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:02:41,128 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:02:41,128 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:02:41,128 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:02:41,129 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:02:41,129 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:02:41,129 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:02:41,130 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:02:41,130 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:02:41,131 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:41,131 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:41,132 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:41,132 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:41,132 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:41,133 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:41,133 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:41,498 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:02:41,500 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-20 09:02:42,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:42,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:42,433 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0005_000001 (auth:SIMPLE) 2023-09-20 09:02:42,461 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0006_000001 (auth:SIMPLE) 2023-09-20 09:02:43,675 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:02:46,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0006_000001 (auth:SIMPLE) 2023-09-20 09:02:48,830 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:02:48,831 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:02:48,837 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:48,837 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:02:48,837 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:02:48,837 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:48,838 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-20 09:02:48,838 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-20 09:02:48,838 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:48,838 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-20 09:02:48,838 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200560117/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-20 09:02:48,843 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-20 09:02:48,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-20 09:02:48,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:48,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-20 09:02:48,847 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200568847"}]},"ts":"1695200568847"} 2023-09-20 09:02:48,848 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-20 09:02:48,850 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-20 09:02:48,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, UNASSIGN}] 2023-09-20 09:02:48,852 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, UNASSIGN 2023-09-20 09:02:48,852 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, UNASSIGN 2023-09-20 09:02:48,853 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0468f695d4d4b6993b086f3e0d6360b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:48,853 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dda3f8afe3bb1e4304a6a060364be813, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:48,853 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200568853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200568853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200568853"}]},"ts":"1695200568853"} 2023-09-20 09:02:48,853 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200568853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200568853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200568853"}]},"ts":"1695200568853"} 2023-09-20 09:02:48,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0468f695d4d4b6993b086f3e0d6360b0, server=jenkins-hbase4.apache.org,37597,1695200470915}] 2023-09-20 09:02:48,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure dda3f8afe3bb1e4304a6a060364be813, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:02:48,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-20 09:02:49,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:49,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:49,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0468f695d4d4b6993b086f3e0d6360b0, disabling compactions & flushes 2023-09-20 09:02:49,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dda3f8afe3bb1e4304a6a060364be813, disabling compactions & flushes 2023-09-20 09:02:49,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:49,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:49,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:49,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:49,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. after waiting 0 ms 2023-09-20 09:02:49,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:49,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. after waiting 0 ms 2023-09-20 09:02:49,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:49,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:02:49,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:02:49,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:49,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:02:49,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0. 2023-09-20 09:02:49,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0468f695d4d4b6993b086f3e0d6360b0: 2023-09-20 09:02:49,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813. 2023-09-20 09:02:49,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dda3f8afe3bb1e4304a6a060364be813: 2023-09-20 09:02:49,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:49,019 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0468f695d4d4b6993b086f3e0d6360b0, regionState=CLOSED 2023-09-20 09:02:49,019 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200569019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200569019"}]},"ts":"1695200569019"} 2023-09-20 09:02:49,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:49,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dda3f8afe3bb1e4304a6a060364be813, regionState=CLOSED 2023-09-20 09:02:49,019 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695200569019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200569019"}]},"ts":"1695200569019"} 2023-09-20 09:02:49,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-20 09:02:49,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0468f695d4d4b6993b086f3e0d6360b0, server=jenkins-hbase4.apache.org,37597,1695200470915 in 166 msec 2023-09-20 09:02:49,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-20 09:02:49,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure dda3f8afe3bb1e4304a6a060364be813, server=jenkins-hbase4.apache.org,45323,1695200471000 in 166 msec 2023-09-20 09:02:49,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0468f695d4d4b6993b086f3e0d6360b0, UNASSIGN in 171 msec 2023-09-20 09:02:49,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-20 09:02:49,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dda3f8afe3bb1e4304a6a060364be813, UNASSIGN in 171 msec 2023-09-20 09:02:49,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200569024"}]},"ts":"1695200569024"} 2023-09-20 09:02:49,025 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-20 09:02:49,027 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-20 09:02:49,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 184 msec 2023-09-20 09:02:49,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-20 09:02:49,149 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-20 09:02:49,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,153 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,154 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,155 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,158 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:49,158 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:49,158 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,158 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,158 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,159 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 09:02:49,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 09:02:49,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 09:02:49,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 09:02:49,160 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/recovered.edits] 2023-09-20 09:02:49,160 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,161 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,161 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/recovered.edits] 2023-09-20 09:02:49,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-20 09:02:49,164 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf/e4557e6bd192444e888b9d749d27280c to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/cf/e4557e6bd192444e888b9d749d27280c 2023-09-20 09:02:49,165 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf/b4d550a2696b4489b83efa1b3b19bc25 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/cf/b4d550a2696b4489b83efa1b3b19bc25 2023-09-20 09:02:49,167 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0/recovered.edits/9.seqid 2023-09-20 09:02:49,168 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/0468f695d4d4b6993b086f3e0d6360b0 2023-09-20 09:02:49,168 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813/recovered.edits/9.seqid 2023-09-20 09:02:49,168 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testEmptyExportFileSystemState/dda3f8afe3bb1e4304a6a060364be813 2023-09-20 09:02:49,168 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-20 09:02:49,169 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-20 09:02:49,169 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-20 09:02:49,172 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230920c0d6a4398b2444009c0b2df723056e78 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230920c0d6a4398b2444009c0b2df723056e78 2023-09-20 09:02:49,173 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309200b28b9c540d44b8280e1b1848b4d2aa1 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309200b28b9c540d44b8280e1b1848b4d2aa1 2023-09-20 09:02:49,173 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-20 09:02:49,175 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,177 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-20 09:02:49,179 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-20 09:02:49,179 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,179 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-20 09:02:49,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200569179"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:49,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200569179"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:49,181 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 09:02:49,181 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0468f695d4d4b6993b086f3e0d6360b0, NAME => 'testtb-testEmptyExportFileSystemState,,1695200558807.0468f695d4d4b6993b086f3e0d6360b0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dda3f8afe3bb1e4304a6a060364be813, NAME => 'testtb-testEmptyExportFileSystemState,1,1695200558807.dda3f8afe3bb1e4304a6a060364be813.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 09:02:49,181 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-20 09:02:49,181 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200569181"}]},"ts":"9223372036854775807"} 2023-09-20 09:02:49,183 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-20 09:02:49,185 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 09:02:49,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 35 msec 2023-09-20 09:02:49,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-20 09:02:49,263 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-20 09:02:49,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-20 09:02:49,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:49,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-20 09:02:49,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-20 09:02:49,297 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:43799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:47480 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1219866137_1 at /127.0.0.1:37440 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4610 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:38450 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:42202 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1219866137_1 at /127.0.0.1:47456 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:44469 from appattempt_1695200477396_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:45273 from appattempt_1695200477396_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x516761b2-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=944 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 210), ProcessCount=167 (was 168), AvailableMemoryMB=11632 (was 11578) - AvailableMemoryMB LEAK? - 2023-09-20 09:02:49,297 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-20 09:02:49,315 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=944, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=167, AvailableMemoryMB=11632 2023-09-20 09:02:49,316 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-20 09:02:49,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 09:02:49,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,320 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 09:02:49,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-20 09:02:49,320 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 09:02:49,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 09:02:49,323 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,323 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 empty. 2023-09-20 09:02:49,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f empty. 2023-09-20 09:02:49,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,323 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,324 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-20 09:02:49,333 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-20 09:02:49,334 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => dbdae6284f743f55efde49d8b5db4879, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:49,334 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e77c0742e7335873072ed0ace0c8528f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e77c0742e7335873072ed0ace0c8528f, disabling compactions & flushes 2023-09-20 09:02:49,355 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. after waiting 0 ms 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,355 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e77c0742e7335873072ed0ace0c8528f: 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:49,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing dbdae6284f743f55efde49d8b5db4879, disabling compactions & flushes 2023-09-20 09:02:49,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. after waiting 0 ms 2023-09-20 09:02:49,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for dbdae6284f743f55efde49d8b5db4879: 2023-09-20 09:02:49,358 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 09:02:49,358 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200569358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200569358"}]},"ts":"1695200569358"} 2023-09-20 09:02:49,359 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200569358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200569358"}]},"ts":"1695200569358"} 2023-09-20 09:02:49,360 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 09:02:49,361 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 09:02:49,361 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200569361"}]},"ts":"1695200569361"} 2023-09-20 09:02:49,362 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-20 09:02:49,371 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 09:02:49,372 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 09:02:49,372 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 09:02:49,372 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 09:02:49,372 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 09:02:49,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, ASSIGN}] 2023-09-20 09:02:49,374 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, ASSIGN 2023-09-20 09:02:49,375 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, ASSIGN 2023-09-20 09:02:49,375 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39705,1695200470965; forceNewPlan=false, retain=false 2023-09-20 09:02:49,375 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45323,1695200471000; forceNewPlan=false, retain=false 2023-09-20 09:02:49,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 09:02:49,525 INFO [jenkins-hbase4:37985] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 09:02:49,528 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=dbdae6284f743f55efde49d8b5db4879, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:49,528 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e77c0742e7335873072ed0ace0c8528f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:49,528 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200569528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200569528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200569528"}]},"ts":"1695200569528"} 2023-09-20 09:02:49,528 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200569528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200569528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200569528"}]},"ts":"1695200569528"} 2023-09-20 09:02:49,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure dbdae6284f743f55efde49d8b5db4879, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:02:49,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure e77c0742e7335873072ed0ace0c8528f, server=jenkins-hbase4.apache.org,39705,1695200470965}] 2023-09-20 09:02:49,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 09:02:49,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e77c0742e7335873072ed0ace0c8528f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 09:02:49,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbdae6284f743f55efde49d8b5db4879, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 09:02:49,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. service=AccessControlService 2023-09-20 09:02:49,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. service=AccessControlService 2023-09-20 09:02:49,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:49,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,686 INFO [StoreOpener-dbdae6284f743f55efde49d8b5db4879-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,686 INFO [StoreOpener-e77c0742e7335873072ed0ace0c8528f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,687 DEBUG [StoreOpener-dbdae6284f743f55efde49d8b5db4879-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf 2023-09-20 09:02:49,687 DEBUG [StoreOpener-dbdae6284f743f55efde49d8b5db4879-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf 2023-09-20 09:02:49,688 DEBUG [StoreOpener-e77c0742e7335873072ed0ace0c8528f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf 2023-09-20 09:02:49,688 DEBUG [StoreOpener-e77c0742e7335873072ed0ace0c8528f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf 2023-09-20 09:02:49,688 INFO [StoreOpener-dbdae6284f743f55efde49d8b5db4879-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbdae6284f743f55efde49d8b5db4879 columnFamilyName cf 2023-09-20 09:02:49,688 INFO [StoreOpener-e77c0742e7335873072ed0ace0c8528f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e77c0742e7335873072ed0ace0c8528f columnFamilyName cf 2023-09-20 09:02:49,689 INFO [StoreOpener-dbdae6284f743f55efde49d8b5db4879-1] regionserver.HStore(310): Store=dbdae6284f743f55efde49d8b5db4879/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:49,689 INFO [StoreOpener-e77c0742e7335873072ed0ace0c8528f-1] regionserver.HStore(310): Store=e77c0742e7335873072ed0ace0c8528f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 09:02:49,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:02:49,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:02:49,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:49,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 09:02:49,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbdae6284f743f55efde49d8b5db4879; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70348760, jitterRate=0.048278212547302246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:49,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbdae6284f743f55efde49d8b5db4879: 2023-09-20 09:02:49,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e77c0742e7335873072ed0ace0c8528f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68542073, jitterRate=0.021356478333473206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 09:02:49,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e77c0742e7335873072ed0ace0c8528f: 2023-09-20 09:02:49,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879., pid=108, masterSystemTime=1695200569681 2023-09-20 09:02:49,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f., pid=109, masterSystemTime=1695200569681 2023-09-20 09:02:49,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,697 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=dbdae6284f743f55efde49d8b5db4879, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:49,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:49,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200569697"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200569697"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200569697"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200569697"}]},"ts":"1695200569697"} 2023-09-20 09:02:49,698 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e77c0742e7335873072ed0ace0c8528f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:49,698 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200569698"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695200569698"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695200569698"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695200569698"}]},"ts":"1695200569698"} 2023-09-20 09:02:49,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-20 09:02:49,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure dbdae6284f743f55efde49d8b5db4879, server=jenkins-hbase4.apache.org,45323,1695200471000 in 169 msec 2023-09-20 09:02:49,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-20 09:02:49,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure e77c0742e7335873072ed0ace0c8528f, server=jenkins-hbase4.apache.org,39705,1695200470965 in 170 msec 2023-09-20 09:02:49,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, ASSIGN in 328 msec 2023-09-20 09:02:49,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-20 09:02:49,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, ASSIGN in 329 msec 2023-09-20 09:02:49,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 09:02:49,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200569703"}]},"ts":"1695200569703"} 2023-09-20 09:02:49,704 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-20 09:02:49,706 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 09:02:49,706 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-20 09:02:49,707 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-20 09:02:49,709 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,709 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,709 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,709 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:02:49,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:49,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:49,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:49,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 09:02:49,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 394 msec 2023-09-20 09:02:49,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 09:02:49,924 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-20 09:02:49,926 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,926 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:49,928 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:02:49,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 09:02:49,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200569939 (current time:1695200569939). 2023-09-20 09:02:49,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:49,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x789412ce to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:49,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4891e55c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:49,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:49,950 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:49,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x789412ce to 127.0.0.1:51278 2023-09-20 09:02:49,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:49,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x616b13cc to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:49,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39317f4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:49,958 DEBUG [hconnection-0x7e4dc632-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:49,960 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:49,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:49,966 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:49,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x616b13cc to 127.0.0.1:51278 2023-09-20 09:02:49,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:49,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-20 09:02:49,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:49,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 09:02:49,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 09:02:49,970 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 09:02:49,971 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695201169971 2023-09-20 09:02:49,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 09:02:49,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:49,973 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 09:02:49,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 09:02:49,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-20 09:02:49,975 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 09:02:49,975 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695201169975 2023-09-20 09:02:49,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,987 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-20 09:02:49,987 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:49,988 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-20 09:02:49,988 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-20 09:02:49,989 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,989 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,992 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:49,992 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:49,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:49,992 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:49,992 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:49,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:49,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,992 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,992 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:49,993 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 09:02:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 09:02:49,993 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 09:02:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:49,995 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 09:02:49,995 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 09:02:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:49,995 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 09:02:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 09:02:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 09:02:49,995 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 09:02:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 09:02:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 09:02:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 09:02:50,005 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,006 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@284c19ad[Count = 1] remaining members to acquire global barrier 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 09:02:50,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@284c19ad[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:50,011 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-20 09:02:50,011 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 09:02:50,012 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 09:02:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 09:02:50,012 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,012 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:50,012 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:50,013 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 09:02:50,013 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. started... 2023-09-20 09:02:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:50,013 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. started... 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e77c0742e7335873072ed0ace0c8528f: 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbdae6284f743f55efde49d8b5db4879: 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:50,014 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 09:02:50,016 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 09:02:50,016 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,016 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 09:02:50,023 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. completed. 2023-09-20 09:02:50,023 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. completed. 2023-09-20 09:02:50,024 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:50,024 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 09:02:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:50,026 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 09:02:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,027 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,027 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 09:02:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 09:02:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,028 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 09:02:50,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39705,1695200470965': 2023-09-20 09:02:50,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-20 09:02:50,035 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-20 09:02:50,035 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:50,035 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:50,036 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,036 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,038 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,039 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,039 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,040 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,041 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,041 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,043 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,043 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,043 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,044 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,044 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,044 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,043 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,043 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,044 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,044 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,045 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,045 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:02:50,046 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,046 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,046 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,046 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,046 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,046 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 09:02:50,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,072 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:50,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 09:02:50,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:02:50,074 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:02:50,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-20 09:02:50,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695200569971Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695200570056 (+85 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695200570056Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695200570056Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695200570059 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695200570065 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695200570077 (+12 ms) 2023-09-20 09:02:50,081 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 09:02:50,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 109 msec 2023-09-20 09:02:50,274 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:50,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 09:02:50,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:50,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45323] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:02:50,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39705] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 09:02:50,280 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,280 DEBUG [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:50,280 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 09:02:50,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 09:02:50,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695200570289 (current time:1695200570289). 2023-09-20 09:02:50,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 09:02:50,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x7b90fb08 to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:50,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b7cde1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:50,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:50,303 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b90fb08 to 127.0.0.1:51278 2023-09-20 09:02:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:50,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(139): Connect 0x36288c5c to 127.0.0.1:51278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 09:02:50,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a9c692a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 09:02:50,315 DEBUG [hconnection-0x471dc249-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:50,316 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:50,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 09:02:50,329 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 09:02:50,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36288c5c to 127.0.0.1:51278 2023-09-20 09:02:50,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:02:50,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-20 09:02:50,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 09:02:50,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 09:02:50,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 09:02:50,335 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 09:02:50,335 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695201170335 2023-09-20 09:02:50,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 09:02:50,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,337 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 09:02:50,337 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 09:02:50,338 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 09:02:50,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 09:02:50,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-20 09:02:50,340 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 09:02:50,340 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695201170340 2023-09-20 09:02:50,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,355 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-20 09:02:50,355 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:50,356 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-20 09:02:50,356 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-20 09:02:50,357 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,357 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,359 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,359 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,359 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,359 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,359 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,360 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,360 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 09:02:50,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 09:02:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 09:02:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 09:02:50,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 09:02:50,367 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37597,1695200470915' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 09:02:50,368 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 09:02:50,369 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 09:02:50,369 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 09:02:50,369 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 09:02:50,371 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,371 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,372 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 09:02:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45323,1695200471000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f95fd1d[Count = 1] remaining members to acquire global barrier 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39705,1695200470965' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 09:02:50,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f95fd1d[Count = 0] remaining members to acquire global barrier 2023-09-20 09:02:50,376 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-20 09:02:50,376 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,381 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,381 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,381 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,382 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 09:02:50,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 09:02:50,382 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:50,382 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:50,382 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 09:02:50,382 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 09:02:50,382 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. started... 2023-09-20 09:02:50,382 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. started... 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37597,1695200470915' in zk 2023-09-20 09:02:50,383 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dbdae6284f743f55efde49d8b5db4879 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-20 09:02:50,382 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 09:02:50,383 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e77c0742e7335873072ed0ace0c8528f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-20 09:02:50,384 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 09:02:50,384 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,384 DEBUG [member: 'jenkins-hbase4.apache.org,37597,1695200470915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 09:02:50,408 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920cf468bd764004545a572a7268bfbd796 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230920cf468bd764004545a572a7268bfbd796 2023-09-20 09:02:50,409 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920b8a340e638e1470898cb69ac9f38a234 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920b8a340e638e1470898cb69ac9f38a234 2023-09-20 09:02:50,419 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/.tmp/cf/b88a159093874cefbba1d72b7948097a 2023-09-20 09:02:50,419 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/.tmp/cf/b4ab32d1273f486db30be6501f1b6794 2023-09-20 09:02:50,424 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/.tmp/cf/b88a159093874cefbba1d72b7948097a as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf/b88a159093874cefbba1d72b7948097a 2023-09-20 09:02:50,424 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/.tmp/cf/b4ab32d1273f486db30be6501f1b6794 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf/b4ab32d1273f486db30be6501f1b6794 2023-09-20 09:02:50,428 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf/b88a159093874cefbba1d72b7948097a, entries=47, sequenceid=6, filesize=13.4 K 2023-09-20 09:02:50,428 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf/b4ab32d1273f486db30be6501f1b6794, entries=3, sequenceid=6, filesize=5.4 K 2023-09-20 09:02:50,429 INFO [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e77c0742e7335873072ed0ace0c8528f in 47ms, sequenceid=6, compaction requested=false 2023-09-20 09:02:50,429 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-20 09:02:50,430 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e77c0742e7335873072ed0ace0c8528f: 2023-09-20 09:02:50,430 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,430 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:50,430 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf/b88a159093874cefbba1d72b7948097a] hfiles 2023-09-20 09:02:50,430 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf/b88a159093874cefbba1d72b7948097a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,430 INFO [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for dbdae6284f743f55efde49d8b5db4879 in 47ms, sequenceid=6, compaction requested=false 2023-09-20 09:02:50,432 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbdae6284f743f55efde49d8b5db4879: 2023-09-20 09:02:50,432 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,432 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 09:02:50,432 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf/b4ab32d1273f486db30be6501f1b6794] hfiles 2023-09-20 09:02:50,432 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf/b4ab32d1273f486db30be6501f1b6794 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,437 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:50,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 09:02:50,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-20 09:02:50,438 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. completed. 2023-09-20 09:02:50,438 DEBUG [rs(jenkins-hbase4.apache.org,39705,1695200470965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:02:50,438 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:50,438 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:50,438 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 09:02:50,438 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39705,1695200470965' in zk 2023-09-20 09:02:50,439 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. completed. 2023-09-20 09:02:50,439 DEBUG [rs(jenkins-hbase4.apache.org,45323,1695200471000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 09:02:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45323,1695200471000' in zk 2023-09-20 09:02:50,440 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 09:02:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1695200470965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 09:02:50,442 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 09:02:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,45323,1695200471000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 09:02:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39705,1695200470965': 2023-09-20 09:02:50,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39705,1695200470965' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45323,1695200471000': 2023-09-20 09:02:50,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45323,1695200471000' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-20 09:02:50,449 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-20 09:02:50,449 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 09:02:50,449 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 09:02:50,449 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,449 INFO [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 09:02:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 09:02:50,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,452 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 09:02:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,453 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,455 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 09:02:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,456 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 09:02:50,456 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,456 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,459 DEBUG [(jenkins-hbase4.apache.org,37985,1695200469633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 09:02:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,459 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 09:02:50,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 09:02:50,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:02:50,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 09:02:50,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 09:02:50,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 09:02:50,462 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:02:50,462 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:02:50,462 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,462 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230920cf468bd764004545a572a7268bfbd796, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920b8a340e638e1470898cb69ac9f38a234] mob files 2023-09-20 09:02:50,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230920cf468bd764004545a572a7268bfbd796 2023-09-20 09:02:50,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920b8a340e638e1470898cb69ac9f38a234 2023-09-20 09:02:50,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-20 09:02:50,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,486 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695200570335Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695200570469 (+134 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695200570469Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695200570469Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695200570472 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695200570479 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695200570486 (+7 ms) 2023-09-20 09:02:50,489 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 09:02:50,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 153 msec 2023-09-20 09:02:50,639 DEBUG [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 09:02:50,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 09:02:50,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 09:02:50,640 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640 2023-09-20 09:02:50,640 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33191, tgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640, rawTgtDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640, srcFsUri=hdfs://localhost:33191, srcDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:50,661 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5 2023-09-20 09:02:50,661 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1683302756_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,661 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33191, inputRoot=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5, snapshotDir=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-20 09:02:50,669 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:02:50,685 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:50,685 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:50,686 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:50,686 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-854347155417636214.jar 2023-09-20 09:02:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,622 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/hadoop-8477915108222293909.jar 2023-09-20 09:02:51,623 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,623 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,623 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,624 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,624 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,624 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 09:02:51,625 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 09:02:51,625 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 09:02:51,625 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 09:02:51,626 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 09:02:51,626 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 09:02:51,626 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 09:02:51,627 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 09:02:51,627 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 09:02:51,627 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 09:02:51,628 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 09:02:51,628 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:51,629 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:51,629 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:51,629 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:51,630 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 09:02:51,630 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:51,631 DEBUG [Listener at jenkins-hbase4.apache.org/32943] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 09:02:51,965 WARN [Listener at jenkins-hbase4.apache.org/32943] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 09:02:51,967 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-20 09:02:51,968 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-20 09:02:53,371 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:53,371 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 09:02:53,374 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0006_000001 (auth:SIMPLE) 2023-09-20 09:02:53,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0007_000001 (auth:SIMPLE) 2023-09-20 09:02:54,603 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:02:57,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0007_000001 (auth:SIMPLE) 2023-09-20 09:02:59,485 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0007_000001 (auth:SIMPLE) 2023-09-20 09:03:02,583 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695200477396_0007_000001 (auth:SIMPLE) 2023-09-20 09:03:04,126 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 09:03:04,126 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 09:03:04,138 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,138 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 09:03:04,138 INFO [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 09:03:04,139 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,139 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-20 09:03:04,139 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-20 09:03:04,139 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1007889893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,140 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-20 09:03:04,140 DEBUG [Listener at jenkins-hbase4.apache.org/32943] snapshot.TestExportSnapshot(367): hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/export-test/export-1695200570640/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-20 09:03:04,146 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-20 09:03:04,150 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200584150"}]},"ts":"1695200584150"} 2023-09-20 09:03:04,152 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-20 09:03:04,153 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-20 09:03:04,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, UNASSIGN}] 2023-09-20 09:03:04,156 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, UNASSIGN 2023-09-20 09:03:04,156 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, UNASSIGN 2023-09-20 09:03:04,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e77c0742e7335873072ed0ace0c8528f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:03:04,157 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=dbdae6284f743f55efde49d8b5db4879, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:03:04,157 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200584157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200584157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200584157"}]},"ts":"1695200584157"} 2023-09-20 09:03:04,157 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200584157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695200584157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695200584157"}]},"ts":"1695200584157"} 2023-09-20 09:03:04,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure e77c0742e7335873072ed0ace0c8528f, server=jenkins-hbase4.apache.org,39705,1695200470965}] 2023-09-20 09:03:04,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure dbdae6284f743f55efde49d8b5db4879, server=jenkins-hbase4.apache.org,45323,1695200471000}] 2023-09-20 09:03:04,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-20 09:03:04,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:03:04,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:03:04,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e77c0742e7335873072ed0ace0c8528f, disabling compactions & flushes 2023-09-20 09:03:04,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbdae6284f743f55efde49d8b5db4879, disabling compactions & flushes 2023-09-20 09:03:04,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:03:04,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:03:04,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:03:04,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:03:04,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. after waiting 0 ms 2023-09-20 09:03:04,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:03:04,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. after waiting 0 ms 2023-09-20 09:03:04,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:03:04,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:03:04,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:03:04,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:04,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:04,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879. 2023-09-20 09:03:04,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f. 2023-09-20 09:03:04,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbdae6284f743f55efde49d8b5db4879: 2023-09-20 09:03:04,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e77c0742e7335873072ed0ace0c8528f: 2023-09-20 09:03:04,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:03:04,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e77c0742e7335873072ed0ace0c8528f, regionState=CLOSED 2023-09-20 09:03:04,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:03:04,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200584325"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200584325"}]},"ts":"1695200584325"} 2023-09-20 09:03:04,326 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=dbdae6284f743f55efde49d8b5db4879, regionState=CLOSED 2023-09-20 09:03:04,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695200584326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695200584326"}]},"ts":"1695200584326"} 2023-09-20 09:03:04,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-20 09:03:04,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure e77c0742e7335873072ed0ace0c8528f, server=jenkins-hbase4.apache.org,39705,1695200470965 in 169 msec 2023-09-20 09:03:04,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-20 09:03:04,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e77c0742e7335873072ed0ace0c8528f, UNASSIGN in 174 msec 2023-09-20 09:03:04,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure dbdae6284f743f55efde49d8b5db4879, server=jenkins-hbase4.apache.org,45323,1695200471000 in 168 msec 2023-09-20 09:03:04,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-20 09:03:04,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dbdae6284f743f55efde49d8b5db4879, UNASSIGN in 176 msec 2023-09-20 09:03:04,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695200584332"}]},"ts":"1695200584332"} 2023-09-20 09:03:04,333 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-20 09:03:04,335 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-20 09:03:04,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-20 09:03:04,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-20 09:03:04,452 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-20 09:03:04,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,456 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,456 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,458 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,460 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:03:04,460 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:03:04,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,461 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 09:03:04,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 09:03:04,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 09:03:04,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 09:03:04,462 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/recovered.edits] 2023-09-20 09:03:04,462 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/recovered.edits] 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:03:04,463 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 09:03:04,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-20 09:03:04,466 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf/b4ab32d1273f486db30be6501f1b6794 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/cf/b4ab32d1273f486db30be6501f1b6794 2023-09-20 09:03:04,466 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf/b88a159093874cefbba1d72b7948097a to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/cf/b88a159093874cefbba1d72b7948097a 2023-09-20 09:03:04,469 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879/recovered.edits/9.seqid 2023-09-20 09:03:04,470 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/recovered.edits/9.seqid to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f/recovered.edits/9.seqid 2023-09-20 09:03:04,470 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dbdae6284f743f55efde49d8b5db4879 2023-09-20 09:03:04,470 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e77c0742e7335873072ed0ace0c8528f 2023-09-20 09:03:04,470 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-20 09:03:04,471 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-20 09:03:04,471 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-20 09:03:04,474 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230920cf468bd764004545a572a7268bfbd796 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230920cf468bd764004545a572a7268bfbd796 2023-09-20 09:03:04,475 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920b8a340e638e1470898cb69ac9f38a234 to hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920b8a340e638e1470898cb69ac9f38a234 2023-09-20 09:03:04,476 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-20 09:03:04,478 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,479 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-20 09:03:04,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-20 09:03:04,482 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,482 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-20 09:03:04,482 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200584482"}]},"ts":"9223372036854775807"} 2023-09-20 09:03:04,482 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695200584482"}]},"ts":"9223372036854775807"} 2023-09-20 09:03:04,484 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 09:03:04,484 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dbdae6284f743f55efde49d8b5db4879, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695200569317.dbdae6284f743f55efde49d8b5db4879.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e77c0742e7335873072ed0ace0c8528f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695200569317.e77c0742e7335873072ed0ace0c8528f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 09:03:04,484 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-20 09:03:04,484 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695200584484"}]},"ts":"9223372036854775807"} 2023-09-20 09:03:04,485 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-20 09:03:04,487 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-20 09:03:04,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-20 09:03:04,565 INFO [Listener at jenkins-hbase4.apache.org/32943] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-20 09:03:04,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-20 09:03:04,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-20 09:03:04,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37985] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 09:03:04,599 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:42864 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_107954660_1 at /127.0.0.1:35448 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:38081 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-5215 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x516761b2-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_107954660_1 at /127.0.0.1:49436 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:49466 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1007889893_17 at /127.0.0.1:35468 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x516761b2-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 944), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 194), ProcessCount=167 (was 167), AvailableMemoryMB=11428 (was 11632) 2023-09-20 09:03:04,600 WARN [Listener at jenkins-hbase4.apache.org/32943] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-20 09:03:04,600 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-20 09:03:04,611 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 09:03:04,722 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695200477396_0007_01_000001 is : 143 2023-09-20 09:03:09,889 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 09:03:18,734 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 09:03:32,849 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-20 09:03:32,850 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 09:03:32,958 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-20 09:03:32,966 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-20 09:03:32,967 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-20 09:03:32,976 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 09:03:33,080 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-20 09:03:33,080 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-20 09:03:33,080 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-20 09:03:33,080 INFO [Listener at jenkins-hbase4.apache.org/32943] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-20 09:03:33,080 DEBUG [Listener at jenkins-hbase4.apache.org/32943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06f7fee9 to 127.0.0.1:51278 2023-09-20 09:03:33,080 DEBUG [Listener at jenkins-hbase4.apache.org/32943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,081 DEBUG [Listener at jenkins-hbase4.apache.org/32943] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-20 09:03:33,081 DEBUG [Listener at jenkins-hbase4.apache.org/32943] util.JVMClusterUtil(257): Found active master hash=526508247, stopped=false 2023-09-20 09:03:33,081 DEBUG [Listener at jenkins-hbase4.apache.org/32943] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,081 DEBUG [Listener at jenkins-hbase4.apache.org/32943] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-20 09:03:33,081 INFO [Listener at jenkins-hbase4.apache.org/32943] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:03:33,082 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 09:03:33,083 INFO [Listener at jenkins-hbase4.apache.org/32943] procedure2.ProcedureExecutor(628): Stopping 2023-09-20 09:03:33,083 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 09:03:33,083 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 09:03:33,082 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 09:03:33,083 DEBUG [Listener at jenkins-hbase4.apache.org/32943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a848ebc to 127.0.0.1:51278 2023-09-20 09:03:33,083 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:03:33,083 DEBUG [Listener at jenkins-hbase4.apache.org/32943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,083 INFO [Listener at jenkins-hbase4.apache.org/32943] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37597,1695200470915' ***** 2023-09-20 09:03:33,083 DEBUG [Listener at jenkins-hbase4.apache.org/32943] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:03:33,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:03:33,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:03:33,083 INFO [Listener at jenkins-hbase4.apache.org/32943] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-20 09:03:33,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 09:03:33,084 INFO [Listener at jenkins-hbase4.apache.org/32943] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39705,1695200470965' ***** 2023-09-20 09:03:33,084 INFO [RS:0;jenkins-hbase4:37597] regionserver.HeapMemoryManager(220): Stopping 2023-09-20 09:03:33,084 DEBUG [Listener at jenkins-hbase4.apache.org/32943] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,084 INFO [RS:0;jenkins-hbase4:37597] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-20 09:03:33,084 INFO [Listener at jenkins-hbase4.apache.org/32943] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-20 09:03:33,084 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-20 09:03:33,084 INFO [RS:0;jenkins-hbase4:37597] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-20 09:03:33,084 INFO [RS:1;jenkins-hbase4:39705] regionserver.HeapMemoryManager(220): Stopping 2023-09-20 09:03:33,084 INFO [Listener at jenkins-hbase4.apache.org/32943] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45323,1695200471000' ***** 2023-09-20 09:03:33,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-20 09:03:33,085 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(3305): Received CLOSE for 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:03:33,085 INFO [RS:1;jenkins-hbase4:39705] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-20 09:03:33,085 DEBUG [Listener at jenkins-hbase4.apache.org/32943] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,085 INFO [RS:1;jenkins-hbase4:39705] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-20 09:03:33,085 INFO [Listener at jenkins-hbase4.apache.org/32943] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-20 09:03:33,085 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:03:33,085 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:03:33,085 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x244eb893 to 127.0.0.1:51278 2023-09-20 09:03:33,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7eb12788278f5398ff0ae9615dc85057, disabling compactions & flushes 2023-09-20 09:03:33,085 DEBUG [RS:0;jenkins-hbase4:37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76486012 to 127.0.0.1:51278 2023-09-20 09:03:33,085 INFO [RS:2;jenkins-hbase4:45323] regionserver.HeapMemoryManager(220): Stopping 2023-09-20 09:03:33,086 DEBUG [RS:0;jenkins-hbase4:37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,086 INFO [RS:2;jenkins-hbase4:45323] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-20 09:03:33,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:03:33,086 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:03:33,089 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39705,1695200470965; all regions closed. 2023-09-20 09:03:33,087 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-20 09:03:33,087 INFO [RS:2;jenkins-hbase4:45323] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-20 09:03:33,086 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-20 09:03:33,089 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1478): Online Regions={7eb12788278f5398ff0ae9615dc85057=hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057.} 2023-09-20 09:03:33,089 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(3305): Received CLOSE for a76486bae3f1aa42beaccac157f78985 2023-09-20 09:03:33,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. after waiting 0 ms 2023-09-20 09:03:33,089 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:03:33,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:03:33,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a76486bae3f1aa42beaccac157f78985, disabling compactions & flushes 2023-09-20 09:03:33,090 DEBUG [RS:2;jenkins-hbase4:45323] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b40a713 to 127.0.0.1:51278 2023-09-20 09:03:33,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7eb12788278f5398ff0ae9615dc85057 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-20 09:03:33,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:03:33,090 DEBUG [RS:2;jenkins-hbase4:45323] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:03:33,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. after waiting 0 ms 2023-09-20 09:03:33,091 INFO [RS:2;jenkins-hbase4:45323] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-20 09:03:33,091 INFO [RS:2;jenkins-hbase4:45323] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-20 09:03:33,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:03:33,091 INFO [RS:2;jenkins-hbase4:45323] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-20 09:03:33,091 DEBUG [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1504): Waiting on 7eb12788278f5398ff0ae9615dc85057 2023-09-20 09:03:33,091 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-20 09:03:33,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a76486bae3f1aa42beaccac157f78985 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-20 09:03:33,091 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-20 09:03:33,092 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1478): Online Regions={a76486bae3f1aa42beaccac157f78985=hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985., 1588230740=hbase:meta,,1.1588230740} 2023-09-20 09:03:33,092 DEBUG [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1504): Waiting on 1588230740, a76486bae3f1aa42beaccac157f78985 2023-09-20 09:03:33,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-20 09:03:33,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-20 09:03:33,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-20 09:03:33,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-20 09:03:33,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-20 09:03:33,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-20 09:03:33,114 DEBUG [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs 2023-09-20 09:03:33,114 INFO [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39705%2C1695200470965:(num 1695200472654) 2023-09-20 09:03:33,114 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,114 INFO [RS:1;jenkins-hbase4:39705] regionserver.LeaseManager(133): Closed leases 2023-09-20 09:03:33,119 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-20 09:03:33,120 INFO [RS:1;jenkins-hbase4:39705] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-20 09:03:33,120 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 09:03:33,120 INFO [RS:1;jenkins-hbase4:39705] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-20 09:03:33,120 INFO [RS:1;jenkins-hbase4:39705] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-20 09:03:33,121 INFO [RS:1;jenkins-hbase4:39705] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39705 2023-09-20 09:03:33,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/.tmp/l/a32657f136db409bb10fa4ffca46acbc 2023-09-20 09:03:33,124 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-20 09:03:33,124 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-20 09:03:33,124 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-20 09:03:33,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/.tmp/info/85e117c78ae0484187f5755995c51db0 2023-09-20 09:03:33,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/.tmp/info/d38166edd20441888fee3c3bb477bb84 2023-09-20 09:03:33,128 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:03:33,128 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:03:33,128 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:03:33,128 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39705,1695200470965 2023-09-20 09:03:33,128 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:03:33,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a32657f136db409bb10fa4ffca46acbc 2023-09-20 09:03:33,128 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:03:33,129 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:03:33,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85e117c78ae0484187f5755995c51db0 2023-09-20 09:03:33,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/.tmp/l/a32657f136db409bb10fa4ffca46acbc as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/l/a32657f136db409bb10fa4ffca46acbc 2023-09-20 09:03:33,130 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39705,1695200470965] 2023-09-20 09:03:33,131 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39705,1695200470965; numProcessing=1 2023-09-20 09:03:33,133 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39705,1695200470965 already deleted, retry=false 2023-09-20 09:03:33,133 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39705,1695200470965 expired; onlineServers=2 2023-09-20 09:03:33,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/.tmp/info/d38166edd20441888fee3c3bb477bb84 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/info/d38166edd20441888fee3c3bb477bb84 2023-09-20 09:03:33,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a32657f136db409bb10fa4ffca46acbc 2023-09-20 09:03:33,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/l/a32657f136db409bb10fa4ffca46acbc, entries=7, sequenceid=18, filesize=5.2 K 2023-09-20 09:03:33,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 7eb12788278f5398ff0ae9615dc85057 in 46ms, sequenceid=18, compaction requested=false 2023-09-20 09:03:33,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/info/d38166edd20441888fee3c3bb477bb84, entries=2, sequenceid=6, filesize=4.8 K 2023-09-20 09:03:33,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a76486bae3f1aa42beaccac157f78985 in 49ms, sequenceid=6, compaction requested=false 2023-09-20 09:03:33,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/.tmp/rep_barrier/9587c0045d134397a5500ea4f4664fa0 2023-09-20 09:03:33,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/acl/7eb12788278f5398ff0ae9615dc85057/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-20 09:03:33,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/namespace/a76486bae3f1aa42beaccac157f78985/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 09:03:33,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:03:33,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7eb12788278f5398ff0ae9615dc85057: 2023-09-20 09:03:33,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695200473851.7eb12788278f5398ff0ae9615dc85057. 2023-09-20 09:03:33,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:03:33,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a76486bae3f1aa42beaccac157f78985: 2023-09-20 09:03:33,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695200473104.a76486bae3f1aa42beaccac157f78985. 2023-09-20 09:03:33,154 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9587c0045d134397a5500ea4f4664fa0 2023-09-20 09:03:33,163 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/.tmp/table/99dcae8b265549fbbc4c9fd8a9b57a14 2023-09-20 09:03:33,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99dcae8b265549fbbc4c9fd8a9b57a14 2023-09-20 09:03:33,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/.tmp/info/85e117c78ae0484187f5755995c51db0 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/info/85e117c78ae0484187f5755995c51db0 2023-09-20 09:03:33,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85e117c78ae0484187f5755995c51db0 2023-09-20 09:03:33,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/info/85e117c78ae0484187f5755995c51db0, entries=48, sequenceid=131, filesize=10.3 K 2023-09-20 09:03:33,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/.tmp/rep_barrier/9587c0045d134397a5500ea4f4664fa0 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/rep_barrier/9587c0045d134397a5500ea4f4664fa0 2023-09-20 09:03:33,184 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9587c0045d134397a5500ea4f4664fa0 2023-09-20 09:03:33,184 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/rep_barrier/9587c0045d134397a5500ea4f4664fa0, entries=13, sequenceid=131, filesize=6.4 K 2023-09-20 09:03:33,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/.tmp/table/99dcae8b265549fbbc4c9fd8a9b57a14 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/table/99dcae8b265549fbbc4c9fd8a9b57a14 2023-09-20 09:03:33,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99dcae8b265549fbbc4c9fd8a9b57a14 2023-09-20 09:03:33,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/table/99dcae8b265549fbbc4c9fd8a9b57a14, entries=24, sequenceid=131, filesize=6.9 K 2023-09-20 09:03:33,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 103ms, sequenceid=131, compaction requested=false 2023-09-20 09:03:33,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-20 09:03:33,208 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 09:03:33,208 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-20 09:03:33,209 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-20 09:03:33,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-20 09:03:33,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-20 09:03:33,230 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,230 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39705,1695200470965; zookeeper connection closed. 2023-09-20 09:03:33,230 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x100c89196280002, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e9f0f14] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e9f0f14 2023-09-20 09:03:33,291 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37597,1695200470915; all regions closed. 2023-09-20 09:03:33,292 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45323,1695200471000; all regions closed. 2023-09-20 09:03:33,299 DEBUG [RS:0;jenkins-hbase4:37597] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs 2023-09-20 09:03:33,299 DEBUG [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs 2023-09-20 09:03:33,299 INFO [RS:0;jenkins-hbase4:37597] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37597%2C1695200470915:(num 1695200472656) 2023-09-20 09:03:33,300 DEBUG [RS:0;jenkins-hbase4:37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,300 INFO [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45323%2C1695200471000.meta:.meta(num 1695200472823) 2023-09-20 09:03:33,300 INFO [RS:0;jenkins-hbase4:37597] regionserver.LeaseManager(133): Closed leases 2023-09-20 09:03:33,300 INFO [RS:0;jenkins-hbase4:37597] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-20 09:03:33,301 INFO [RS:0;jenkins-hbase4:37597] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-20 09:03:33,301 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 09:03:33,301 INFO [RS:0;jenkins-hbase4:37597] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-20 09:03:33,301 INFO [RS:0;jenkins-hbase4:37597] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-20 09:03:33,302 INFO [RS:0;jenkins-hbase4:37597] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37597 2023-09-20 09:03:33,304 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:03:33,304 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:03:33,305 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37597,1695200470915 2023-09-20 09:03:33,306 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37597,1695200470915] 2023-09-20 09:03:33,306 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37597,1695200470915; numProcessing=2 2023-09-20 09:03:33,307 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37597,1695200470915 already deleted, retry=false 2023-09-20 09:03:33,307 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37597,1695200470915 expired; onlineServers=1 2023-09-20 09:03:33,308 DEBUG [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/oldWALs 2023-09-20 09:03:33,308 INFO [RS:2;jenkins-hbase4:45323] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45323%2C1695200471000:(num 1695200472656) 2023-09-20 09:03:33,308 DEBUG [RS:2;jenkins-hbase4:45323] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,308 INFO [RS:2;jenkins-hbase4:45323] regionserver.LeaseManager(133): Closed leases 2023-09-20 09:03:33,308 INFO [RS:2;jenkins-hbase4:45323] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-20 09:03:33,308 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 09:03:33,309 INFO [RS:2;jenkins-hbase4:45323] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45323 2023-09-20 09:03:33,311 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45323,1695200471000 2023-09-20 09:03:33,311 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 09:03:33,313 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45323,1695200471000] 2023-09-20 09:03:33,313 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45323,1695200471000; numProcessing=3 2023-09-20 09:03:33,314 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45323,1695200471000 already deleted, retry=false 2023-09-20 09:03:33,314 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45323,1695200471000 expired; onlineServers=0 2023-09-20 09:03:33,314 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37985,1695200469633' ***** 2023-09-20 09:03:33,314 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-20 09:03:33,314 DEBUG [M:0;jenkins-hbase4:37985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e5ceaec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 09:03:33,314 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37985,1695200469633 2023-09-20 09:03:33,314 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37985,1695200469633; all regions closed. 2023-09-20 09:03:33,314 DEBUG [M:0;jenkins-hbase4:37985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 09:03:33,314 DEBUG [M:0;jenkins-hbase4:37985] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-20 09:03:33,315 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-20 09:03:33,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695200472280] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695200472280,5,FailOnTimeoutGroup] 2023-09-20 09:03:33,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695200472280] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695200472280,5,FailOnTimeoutGroup] 2023-09-20 09:03:33,315 DEBUG [M:0;jenkins-hbase4:37985] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-20 09:03:33,315 INFO [M:0;jenkins-hbase4:37985] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-20 09:03:33,315 INFO [M:0;jenkins-hbase4:37985] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-20 09:03:33,315 INFO [M:0;jenkins-hbase4:37985] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-20 09:03:33,315 DEBUG [M:0;jenkins-hbase4:37985] master.HMaster(1512): Stopping service threads 2023-09-20 09:03:33,315 INFO [M:0;jenkins-hbase4:37985] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-20 09:03:33,316 ERROR [M:0;jenkins-hbase4:37985] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-20 09:03:33,316 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-20 09:03:33,316 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 09:03:33,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 09:03:33,316 INFO [M:0;jenkins-hbase4:37985] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-20 09:03:33,316 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-20 09:03:33,317 DEBUG [M:0;jenkins-hbase4:37985] zookeeper.ZKUtil(398): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-20 09:03:33,317 WARN [M:0;jenkins-hbase4:37985] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-20 09:03:33,317 INFO [M:0;jenkins-hbase4:37985] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-20 09:03:33,317 INFO [M:0;jenkins-hbase4:37985] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-20 09:03:33,318 DEBUG [M:0;jenkins-hbase4:37985] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-20 09:03:33,318 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:03:33,318 DEBUG [M:0;jenkins-hbase4:37985] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:03:33,318 DEBUG [M:0;jenkins-hbase4:37985] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-20 09:03:33,318 DEBUG [M:0;jenkins-hbase4:37985] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:03:33,318 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.84 KB heapSize=452.09 KB 2023-09-20 09:03:33,336 INFO [M:0;jenkins-hbase4:37985] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.84 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ec5db5b0a7a5458a828a20922f496fb8 2023-09-20 09:03:33,340 INFO [M:0;jenkins-hbase4:37985] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec5db5b0a7a5458a828a20922f496fb8 2023-09-20 09:03:33,341 DEBUG [M:0;jenkins-hbase4:37985] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ec5db5b0a7a5458a828a20922f496fb8 as hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ec5db5b0a7a5458a828a20922f496fb8 2023-09-20 09:03:33,345 INFO [M:0;jenkins-hbase4:37985] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec5db5b0a7a5458a828a20922f496fb8 2023-09-20 09:03:33,345 INFO [M:0;jenkins-hbase4:37985] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/fc9e0082-32c8-3afd-32e9-f1870d1939e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ec5db5b0a7a5458a828a20922f496fb8, entries=119, sequenceid=899, filesize=28.7 K 2023-09-20 09:03:33,346 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegion(2948): Finished flush of dataSize ~375.84 KB/384858, heapSize ~452.07 KB/462920, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-09-20 09:03:33,348 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 09:03:33,348 DEBUG [M:0;jenkins-hbase4:37985] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-20 09:03:33,352 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 09:03:33,352 INFO [M:0;jenkins-hbase4:37985] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-20 09:03:33,352 INFO [M:0;jenkins-hbase4:37985] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37985 2023-09-20 09:03:33,355 DEBUG [M:0;jenkins-hbase4:37985] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37985,1695200469633 already deleted, retry=false 2023-09-20 09:03:33,407 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,407 INFO [RS:0;jenkins-hbase4:37597] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37597,1695200470915; zookeeper connection closed. 2023-09-20 09:03:33,407 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:37597-0x100c89196280001, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,407 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@430924ce] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@430924ce 2023-09-20 09:03:33,507 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,507 INFO [M:0;jenkins-hbase4:37985] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37985,1695200469633; zookeeper connection closed. 2023-09-20 09:03:33,507 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): master:37985-0x100c89196280000, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,607 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,607 INFO [RS:2;jenkins-hbase4:45323] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45323,1695200471000; zookeeper connection closed. 2023-09-20 09:03:33,607 DEBUG [Listener at localhost/38007-EventThread] zookeeper.ZKWatcher(600): regionserver:45323-0x100c89196280003, quorum=127.0.0.1:51278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 09:03:33,608 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f66681e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f66681e 2023-09-20 09:03:33,608 INFO [Listener at jenkins-hbase4.apache.org/32943] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-20 09:03:33,608 WARN [Listener at jenkins-hbase4.apache.org/32943] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-20 09:03:33,611 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 09:03:33,715 WARN [BP-442182684-172.31.14.131-1695200465798 heartbeating to localhost/127.0.0.1:33191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-20 09:03:33,715 WARN [BP-442182684-172.31.14.131-1695200465798 heartbeating to localhost/127.0.0.1:33191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-442182684-172.31.14.131-1695200465798 (Datanode Uuid 0d7ce7cc-3ade-4b9b-b3c5-982ed066fe23) service to localhost/127.0.0.1:33191 2023-09-20 09:03:33,717 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data5/current/BP-442182684-172.31.14.131-1695200465798] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 09:03:33,717 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data6/current/BP-442182684-172.31.14.131-1695200465798] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 09:03:33,718 WARN [Listener at jenkins-hbase4.apache.org/32943] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-20 09:03:33,720 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 09:03:33,823 WARN [BP-442182684-172.31.14.131-1695200465798 heartbeating to localhost/127.0.0.1:33191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-20 09:03:33,823 WARN [BP-442182684-172.31.14.131-1695200465798 heartbeating to localhost/127.0.0.1:33191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-442182684-172.31.14.131-1695200465798 (Datanode Uuid a51249bd-ad0c-4eee-9bfb-ef85f06e6f8d) service to localhost/127.0.0.1:33191 2023-09-20 09:03:33,824 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data3/current/BP-442182684-172.31.14.131-1695200465798] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 09:03:33,824 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data4/current/BP-442182684-172.31.14.131-1695200465798] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 09:03:33,825 WARN [Listener at jenkins-hbase4.apache.org/32943] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-20 09:03:33,827 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 09:03:33,931 WARN [BP-442182684-172.31.14.131-1695200465798 heartbeating to localhost/127.0.0.1:33191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-20 09:03:33,931 WARN [BP-442182684-172.31.14.131-1695200465798 heartbeating to localhost/127.0.0.1:33191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-442182684-172.31.14.131-1695200465798 (Datanode Uuid 1d16daaf-cc84-4bd1-8a99-7b03caf28eeb) service to localhost/127.0.0.1:33191 2023-09-20 09:03:33,932 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data1/current/BP-442182684-172.31.14.131-1695200465798] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 09:03:33,932 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/055d38df-11f3-b00a-10f1-930e22aefa8f/cluster_6886e736-a829-c5f9-aa5c-fb3e24e7da6b/dfs/data/data2/current/BP-442182684-172.31.14.131-1695200465798] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 09:03:33,953 INFO [Listener at jenkins-hbase4.apache.org/32943] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 09:03:34,078 INFO [Listener at jenkins-hbase4.apache.org/32943] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-20 09:03:34,170 INFO [Listener at jenkins-hbase4.apache.org/32943] hbase.HBaseTestingUtility(1293): Minicluster is down