2023-09-23 00:01:45,756 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-23 00:01:45,979 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6 2023-09-23 00:01:45,980 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-23 00:01:45,980 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-23 00:01:46,020 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-23 00:01:46,270 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-23 00:01:46,270 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112, deleteOnExit=true 2023-09-23 00:01:46,271 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-23 00:01:46,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/test.cache.data in system properties and HBase conf 2023-09-23 00:01:46,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 00:01:46,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop.log.dir in system properties and HBase conf 2023-09-23 00:01:46,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 00:01:46,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 00:01:46,272 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 00:01:46,597 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-23 00:01:46,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 00:01:46,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 00:01:46,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 00:01:46,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 00:01:46,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 00:01:46,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 00:01:46,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 00:01:46,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 00:01:46,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 00:01:46,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/nfs.dump.dir in system properties and HBase conf 2023-09-23 00:01:46,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir in system properties and HBase conf 2023-09-23 00:01:46,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 00:01:46,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 00:01:46,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-23 00:01:47,103 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 00:01:47,108 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 00:01:47,424 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-23 00:01:47,600 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-23 00:01:47,613 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:47,651 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:47,685 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_localhost_32987_hdfs____.muh82l/webapp 2023-09-23 00:01:47,819 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32987 2023-09-23 00:01:47,858 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 00:01:47,858 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 00:01:48,322 WARN [Listener at localhost/33037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 00:01:48,407 WARN [Listener at localhost/33037] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 00:01:48,431 WARN [Listener at localhost/33037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:48,438 INFO [Listener at localhost/33037] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:48,444 INFO [Listener at localhost/33037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_localhost_39911_datanode____.g47v6u/webapp 2023-09-23 00:01:48,553 INFO [Listener at localhost/33037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39911 2023-09-23 00:01:48,983 WARN [Listener at localhost/46571] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 00:01:49,004 WARN [Listener at localhost/46571] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 00:01:49,009 WARN [Listener at localhost/46571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:49,011 INFO [Listener at localhost/46571] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:49,025 INFO [Listener at localhost/46571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_localhost_34655_datanode____.uiphz8/webapp 2023-09-23 00:01:49,166 INFO [Listener at localhost/46571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34655 2023-09-23 00:01:49,177 WARN [Listener at localhost/33361] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 00:01:49,199 WARN [Listener at localhost/33361] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 00:01:49,203 WARN [Listener at localhost/33361] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:49,206 INFO [Listener at localhost/33361] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:49,214 INFO [Listener at localhost/33361] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_localhost_35367_datanode____a8iq2h/webapp 2023-09-23 00:01:49,345 INFO [Listener at localhost/33361] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35367 2023-09-23 00:01:49,369 WARN [Listener at localhost/39051] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 00:01:49,657 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28382db573b7810b: Processing first storage report for DS-3abd59aa-3de7-452a-b8da-174d7f353daa from datanode b8a29e98-fb39-4c12-bce6-99b92c63747d 2023-09-23 00:01:49,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28382db573b7810b: from storage DS-3abd59aa-3de7-452a-b8da-174d7f353daa node DatanodeRegistration(127.0.0.1:44687, datanodeUuid=b8a29e98-fb39-4c12-bce6-99b92c63747d, infoPort=40957, infoSecurePort=0, ipcPort=39051, storageInfo=lv=-57;cid=testClusterID;nsid=1130112502;c=1695427307191), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-23 00:01:49,660 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56d6f92bd3705b45: Processing first storage report for DS-f868bad1-abef-41f6-97e2-de9597c9cdf9 from datanode 0bff42e4-de09-46ea-af63-5c7eaf35e3fa 2023-09-23 00:01:49,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56d6f92bd3705b45: from storage DS-f868bad1-abef-41f6-97e2-de9597c9cdf9 node DatanodeRegistration(127.0.0.1:37479, datanodeUuid=0bff42e4-de09-46ea-af63-5c7eaf35e3fa, infoPort=38455, infoSecurePort=0, ipcPort=46571, storageInfo=lv=-57;cid=testClusterID;nsid=1130112502;c=1695427307191), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-23 00:01:49,661 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fec4eed8e639ad7: Processing first storage report for DS-351d42e8-5bf8-426b-b514-bf1a075f3700 from datanode 975b6600-d1ed-44fb-bec8-9e00a7c39cb2 2023-09-23 00:01:49,661 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fec4eed8e639ad7: from storage DS-351d42e8-5bf8-426b-b514-bf1a075f3700 node DatanodeRegistration(127.0.0.1:35647, datanodeUuid=975b6600-d1ed-44fb-bec8-9e00a7c39cb2, infoPort=34475, infoSecurePort=0, ipcPort=33361, storageInfo=lv=-57;cid=testClusterID;nsid=1130112502;c=1695427307191), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 00:01:49,661 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28382db573b7810b: Processing first storage report for DS-9e62ba7a-d664-49d9-8fe2-2cb413e02554 from datanode b8a29e98-fb39-4c12-bce6-99b92c63747d 2023-09-23 00:01:49,661 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28382db573b7810b: from storage DS-9e62ba7a-d664-49d9-8fe2-2cb413e02554 node DatanodeRegistration(127.0.0.1:44687, datanodeUuid=b8a29e98-fb39-4c12-bce6-99b92c63747d, infoPort=40957, infoSecurePort=0, ipcPort=39051, storageInfo=lv=-57;cid=testClusterID;nsid=1130112502;c=1695427307191), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-23 00:01:49,661 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56d6f92bd3705b45: Processing first storage report for DS-6499cdf6-dd3e-4738-aef4-4351faef179d from datanode 0bff42e4-de09-46ea-af63-5c7eaf35e3fa 2023-09-23 00:01:49,662 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56d6f92bd3705b45: from storage DS-6499cdf6-dd3e-4738-aef4-4351faef179d node DatanodeRegistration(127.0.0.1:37479, datanodeUuid=0bff42e4-de09-46ea-af63-5c7eaf35e3fa, infoPort=38455, infoSecurePort=0, ipcPort=46571, storageInfo=lv=-57;cid=testClusterID;nsid=1130112502;c=1695427307191), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 00:01:49,662 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fec4eed8e639ad7: Processing first storage report for DS-30d62d8b-3d4d-4d7a-ab78-2539d364eb8f from datanode 975b6600-d1ed-44fb-bec8-9e00a7c39cb2 2023-09-23 00:01:49,662 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fec4eed8e639ad7: from storage DS-30d62d8b-3d4d-4d7a-ab78-2539d364eb8f node DatanodeRegistration(127.0.0.1:35647, datanodeUuid=975b6600-d1ed-44fb-bec8-9e00a7c39cb2, infoPort=34475, infoSecurePort=0, ipcPort=33361, storageInfo=lv=-57;cid=testClusterID;nsid=1130112502;c=1695427307191), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 00:01:49,894 DEBUG [Listener at localhost/39051] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6 2023-09-23 00:01:49,984 INFO [Listener at localhost/39051] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/zookeeper_0, clientPort=52502, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-23 00:01:50,002 INFO [Listener at localhost/39051] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52502 2023-09-23 00:01:50,013 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:50,016 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:50,713 INFO [Listener at localhost/39051] util.FSUtils(471): Created version file at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 with version=8 2023-09-23 00:01:50,713 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/hbase-staging 2023-09-23 00:01:51,133 INFO [Listener at localhost/39051] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-23 00:01:51,666 INFO [Listener at localhost/39051] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 00:01:51,699 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:51,700 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:51,700 INFO [Listener at localhost/39051] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 00:01:51,700 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:51,700 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 00:01:51,842 INFO [Listener at localhost/39051] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 00:01:51,914 DEBUG [Listener at localhost/39051] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-23 00:01:52,007 INFO [Listener at localhost/39051] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44537 2023-09-23 00:01:52,020 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,023 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,047 INFO [Listener at localhost/39051] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44537 connecting to ZooKeeper ensemble=127.0.0.1:52502 2023-09-23 00:01:52,107 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:445370x0, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 00:01:52,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44537-0x100d616e9310000 connected 2023-09-23 00:01:52,142 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 00:01:52,143 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:01:52,156 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 00:01:52,164 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44537 2023-09-23 00:01:52,164 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44537 2023-09-23 00:01:52,164 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44537 2023-09-23 00:01:52,165 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44537 2023-09-23 00:01:52,165 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44537 2023-09-23 00:01:52,171 INFO [Listener at localhost/39051] master.HMaster(444): hbase.rootdir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, hbase.cluster.distributed=false 2023-09-23 00:01:52,236 INFO [Listener at localhost/39051] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 00:01:52,236 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,236 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,236 INFO [Listener at localhost/39051] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 00:01:52,236 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,236 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 00:01:52,241 INFO [Listener at localhost/39051] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 00:01:52,244 INFO [Listener at localhost/39051] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44515 2023-09-23 00:01:52,247 INFO [Listener at localhost/39051] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 00:01:52,253 INFO [Listener at localhost/39051] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 00:01:52,254 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,256 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,259 INFO [Listener at localhost/39051] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44515 connecting to ZooKeeper ensemble=127.0.0.1:52502 2023-09-23 00:01:52,267 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:445150x0, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 00:01:52,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44515-0x100d616e9310001 connected 2023-09-23 00:01:52,268 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 00:01:52,270 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:01:52,271 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 00:01:52,271 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44515 2023-09-23 00:01:52,271 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44515 2023-09-23 00:01:52,273 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44515 2023-09-23 00:01:52,274 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44515 2023-09-23 00:01:52,279 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44515 2023-09-23 00:01:52,292 INFO [Listener at localhost/39051] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 00:01:52,293 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,293 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,294 INFO [Listener at localhost/39051] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 00:01:52,294 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,294 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 00:01:52,294 INFO [Listener at localhost/39051] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 00:01:52,296 INFO [Listener at localhost/39051] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37611 2023-09-23 00:01:52,297 INFO [Listener at localhost/39051] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 00:01:52,298 INFO [Listener at localhost/39051] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 00:01:52,299 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,302 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,305 INFO [Listener at localhost/39051] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37611 connecting to ZooKeeper ensemble=127.0.0.1:52502 2023-09-23 00:01:52,309 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:376110x0, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 00:01:52,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37611-0x100d616e9310002 connected 2023-09-23 00:01:52,310 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 00:01:52,311 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:01:52,312 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 00:01:52,313 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37611 2023-09-23 00:01:52,316 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37611 2023-09-23 00:01:52,316 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37611 2023-09-23 00:01:52,317 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37611 2023-09-23 00:01:52,317 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37611 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 00:01:52,329 INFO [Listener at localhost/39051] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 00:01:52,331 INFO [Listener at localhost/39051] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42773 2023-09-23 00:01:52,331 INFO [Listener at localhost/39051] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 00:01:52,333 INFO [Listener at localhost/39051] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 00:01:52,334 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,335 INFO [Listener at localhost/39051] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,337 INFO [Listener at localhost/39051] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42773 connecting to ZooKeeper ensemble=127.0.0.1:52502 2023-09-23 00:01:52,341 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:427730x0, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 00:01:52,342 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:427730x0, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 00:01:52,342 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:427730x0, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:01:52,343 DEBUG [Listener at localhost/39051] zookeeper.ZKUtil(164): regionserver:427730x0, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 00:01:52,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42773-0x100d616e9310003 connected 2023-09-23 00:01:52,345 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42773 2023-09-23 00:01:52,345 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42773 2023-09-23 00:01:52,346 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42773 2023-09-23 00:01:52,346 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42773 2023-09-23 00:01:52,346 DEBUG [Listener at localhost/39051] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42773 2023-09-23 00:01:52,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:52,361 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 00:01:52,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:52,388 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 00:01:52,388 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 00:01:52,388 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 00:01:52,388 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 00:01:52,388 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:52,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 00:01:52,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44537,1695427310899 from backup master directory 2023-09-23 00:01:52,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 00:01:52,395 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:52,395 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 00:01:52,396 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 00:01:52,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:52,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-23 00:01:52,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-23 00:01:52,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/hbase.id with ID: 99637415-92b5-4957-8465-4089ed9e1b13 2023-09-23 00:01:52,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 00:01:52,555 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:52,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x18af9798 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:01:52,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21f7e1c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:01:52,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 00:01:52,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-23 00:01:52,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-23 00:01:52,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-23 00:01:52,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 00:01:52,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 00:01:52,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 00:01:52,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store-tmp 2023-09-23 00:01:52,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:52,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 00:01:52,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:01:52,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:01:52,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 00:01:52,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:01:52,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:01:52,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 00:01:52,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/WALs/jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:52,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44537%2C1695427310899, suffix=, logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/WALs/jenkins-hbase4.apache.org,44537,1695427310899, archiveDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/oldWALs, maxLogs=10 2023-09-23 00:01:52,873 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK] 2023-09-23 00:01:52,873 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK] 2023-09-23 00:01:52,873 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK] 2023-09-23 00:01:52,882 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-23 00:01:52,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/WALs/jenkins-hbase4.apache.org,44537,1695427310899/jenkins-hbase4.apache.org%2C44537%2C1695427310899.1695427312812 2023-09-23 00:01:52,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK], DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK], DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK]] 2023-09-23 00:01:52,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-23 00:01:52,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:52,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 00:01:52,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 00:01:53,026 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-23 00:01:53,033 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-23 00:01:53,060 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-23 00:01:53,073 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:53,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 00:01:53,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 00:01:53,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 00:01:53,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:01:53,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75305602, jitterRate=0.12214091420173645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:01:53,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 00:01:53,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-23 00:01:53,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-23 00:01:53,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-23 00:01:53,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-23 00:01:53,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-23 00:01:53,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-23 00:01:53,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-23 00:01:53,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-23 00:01:53,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-23 00:01:53,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-23 00:01:53,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-23 00:01:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-23 00:01:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-23 00:01:53,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-23 00:01:53,249 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:53,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-23 00:01:53,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-23 00:01:53,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-23 00:01:53,269 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 00:01:53,269 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 00:01:53,269 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 00:01:53,269 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 00:01:53,270 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:53,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44537,1695427310899, sessionid=0x100d616e9310000, setting cluster-up flag (Was=false) 2023-09-23 00:01:53,292 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:53,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-23 00:01:53,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:53,307 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:53,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-23 00:01:53,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:53,317 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp 2023-09-23 00:01:53,351 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(951): ClusterId : 99637415-92b5-4957-8465-4089ed9e1b13 2023-09-23 00:01:53,351 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(951): ClusterId : 99637415-92b5-4957-8465-4089ed9e1b13 2023-09-23 00:01:53,351 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(951): ClusterId : 99637415-92b5-4957-8465-4089ed9e1b13 2023-09-23 00:01:53,359 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 00:01:53,359 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 00:01:53,359 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 00:01:53,368 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 00:01:53,368 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 00:01:53,368 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 00:01:53,368 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 00:01:53,368 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 00:01:53,368 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 00:01:53,372 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 00:01:53,372 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 00:01:53,375 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 00:01:53,376 DEBUG [RS:0;jenkins-hbase4:44515] zookeeper.ReadOnlyZKClient(139): Connect 0x02ea2e4b to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:01:53,376 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ReadOnlyZKClient(139): Connect 0x2079b8bc to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:01:53,378 DEBUG [RS:1;jenkins-hbase4:37611] zookeeper.ReadOnlyZKClient(139): Connect 0x3d91f308 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:01:53,389 DEBUG [RS:0;jenkins-hbase4:44515] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c2dd066, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:01:53,390 DEBUG [RS:0;jenkins-hbase4:44515] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@812453b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 00:01:53,420 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ebe42c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:01:53,420 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a81d3cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 00:01:53,420 DEBUG [RS:1;jenkins-hbase4:37611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33560aca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:01:53,421 DEBUG [RS:1;jenkins-hbase4:37611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37699878, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 00:01:53,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-23 00:01:53,445 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44515 2023-09-23 00:01:53,445 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42773 2023-09-23 00:01:53,446 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37611 2023-09-23 00:01:53,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:53,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-23 00:01:53,452 INFO [RS:2;jenkins-hbase4:42773] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 00:01:53,452 INFO [RS:1;jenkins-hbase4:37611] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 00:01:53,453 INFO [RS:1;jenkins-hbase4:37611] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 00:01:53,452 INFO [RS:0;jenkins-hbase4:44515] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 00:01:53,452 INFO [RS:2;jenkins-hbase4:42773] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 00:01:53,453 INFO [RS:0;jenkins-hbase4:44515] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 00:01:53,453 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 00:01:53,453 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 00:01:53,453 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 00:01:53,454 INFO [RS:1;jenkins-hbase4:37611] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:53,454 INFO [RS:0;jenkins-hbase4:44515] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:53,454 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 00:01:53,453 INFO [RS:2;jenkins-hbase4:42773] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:53,454 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 00:01:53,454 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 00:01:53,459 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44537,1695427310899 with isa=jenkins-hbase4.apache.org/172.31.14.131:44515, startcode=1695427312235 2023-09-23 00:01:53,459 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44537,1695427310899 with isa=jenkins-hbase4.apache.org/172.31.14.131:42773, startcode=1695427312328 2023-09-23 00:01:53,459 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44537,1695427310899 with isa=jenkins-hbase4.apache.org/172.31.14.131:37611, startcode=1695427312292 2023-09-23 00:01:53,478 DEBUG [RS:0;jenkins-hbase4:44515] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 00:01:53,478 DEBUG [RS:1;jenkins-hbase4:37611] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 00:01:53,478 DEBUG [RS:2;jenkins-hbase4:42773] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 00:01:53,532 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46055, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 00:01:53,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-23 00:01:53,532 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37927, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 00:01:53,533 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56755, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 00:01:53,542 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44537] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 00:01:53,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 00:01:53,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 00:01:53,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 00:01:53,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 00:01:53,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-23 00:01:53,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 00:01:53,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,550 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44537] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 00:01:53,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695427343550 2023-09-23 00:01:53,551 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44537] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 00:01:53,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-23 00:01:53,564 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 00:01:53,564 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-23 00:01:53,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-23 00:01:53,570 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 00:01:53,572 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 00:01:53,573 WARN [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 00:01:53,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-23 00:01:53,577 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 00:01:53,577 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 00:01:53,577 WARN [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 00:01:53,577 WARN [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 00:01:53,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-23 00:01:53,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-23 00:01:53,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-23 00:01:53,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-23 00:01:53,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-23 00:01:53,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-23 00:01:53,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-23 00:01:53,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-23 00:01:53,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695427313587,5,FailOnTimeoutGroup] 2023-09-23 00:01:53,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695427313587,5,FailOnTimeoutGroup] 2023-09-23 00:01:53,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-23 00:01:53,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,611 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 00:01:53,612 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 00:01:53,613 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:01:53,636 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:53,639 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 00:01:53,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/info 2023-09-23 00:01:53,642 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 00:01:53,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:53,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 00:01:53,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/rep_barrier 2023-09-23 00:01:53,646 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 00:01:53,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:53,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 00:01:53,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/table 2023-09-23 00:01:53,650 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 00:01:53,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:53,652 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740 2023-09-23 00:01:53,653 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740 2023-09-23 00:01:53,657 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 00:01:53,659 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 00:01:53,663 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:01:53,664 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60059860, jitterRate=-0.1050383448600769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 00:01:53,664 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 00:01:53,664 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 00:01:53,664 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 00:01:53,664 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 00:01:53,665 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 00:01:53,665 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 00:01:53,667 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 00:01:53,667 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 00:01:53,674 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 00:01:53,674 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-23 00:01:53,674 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44537,1695427310899 with isa=jenkins-hbase4.apache.org/172.31.14.131:42773, startcode=1695427312328 2023-09-23 00:01:53,678 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44537,1695427310899 with isa=jenkins-hbase4.apache.org/172.31.14.131:44515, startcode=1695427312235 2023-09-23 00:01:53,678 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44537,1695427310899 with isa=jenkins-hbase4.apache.org/172.31.14.131:37611, startcode=1695427312292 2023-09-23 00:01:53,681 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44537] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,687 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44537] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,688 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:01:53,688 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44537] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,688 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33037 2023-09-23 00:01:53,688 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 00:01:53,688 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:01:53,689 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33037 2023-09-23 00:01:53,689 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 00:01:53,690 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:01:53,690 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33037 2023-09-23 00:01:53,690 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 00:01:53,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-23 00:01:53,699 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:01:53,703 DEBUG [RS:0;jenkins-hbase4:44515] zookeeper.ZKUtil(162): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,703 WARN [RS:0;jenkins-hbase4:44515] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 00:01:53,703 DEBUG [RS:1;jenkins-hbase4:37611] zookeeper.ZKUtil(162): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,703 INFO [RS:0;jenkins-hbase4:44515] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 00:01:53,703 WARN [RS:1;jenkins-hbase4:37611] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 00:01:53,704 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,707 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44515,1695427312235] 2023-09-23 00:01:53,707 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42773,1695427312328] 2023-09-23 00:01:53,707 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37611,1695427312292] 2023-09-23 00:01:53,704 INFO [RS:1;jenkins-hbase4:37611] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 00:01:53,708 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,708 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,708 WARN [RS:2;jenkins-hbase4:42773] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 00:01:53,709 INFO [RS:2;jenkins-hbase4:42773] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 00:01:53,709 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,710 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-23 00:01:53,718 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-23 00:01:53,724 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,724 DEBUG [RS:0;jenkins-hbase4:44515] zookeeper.ZKUtil(162): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,724 DEBUG [RS:1;jenkins-hbase4:37611] zookeeper.ZKUtil(162): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,724 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,724 DEBUG [RS:0;jenkins-hbase4:44515] zookeeper.ZKUtil(162): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,725 DEBUG [RS:1;jenkins-hbase4:37611] zookeeper.ZKUtil(162): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,725 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,725 DEBUG [RS:0;jenkins-hbase4:44515] zookeeper.ZKUtil(162): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,725 DEBUG [RS:1;jenkins-hbase4:37611] zookeeper.ZKUtil(162): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,737 DEBUG [RS:1;jenkins-hbase4:37611] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 00:01:53,737 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 00:01:53,737 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 00:01:53,748 INFO [RS:1;jenkins-hbase4:37611] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 00:01:53,748 INFO [RS:2;jenkins-hbase4:42773] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 00:01:53,748 INFO [RS:0;jenkins-hbase4:44515] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 00:01:53,773 INFO [RS:2;jenkins-hbase4:42773] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 00:01:53,773 INFO [RS:1;jenkins-hbase4:37611] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 00:01:53,774 INFO [RS:0;jenkins-hbase4:44515] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 00:01:53,779 INFO [RS:2;jenkins-hbase4:42773] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 00:01:53,779 INFO [RS:0;jenkins-hbase4:44515] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 00:01:53,779 INFO [RS:1;jenkins-hbase4:37611] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 00:01:53,780 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,780 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,780 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,782 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 00:01:53,782 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 00:01:53,782 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 00:01:53,791 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,791 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,791 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,791 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 00:01:53,792 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 00:01:53,793 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,792 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:0;jenkins-hbase4:44515] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,793 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,794 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,794 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 00:01:53,795 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,795 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,795 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,795 DEBUG [RS:1;jenkins-hbase4:37611] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 00:01:53,797 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,797 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,797 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,797 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,798 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,798 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,798 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,798 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,798 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,818 INFO [RS:1;jenkins-hbase4:37611] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 00:01:53,818 INFO [RS:2;jenkins-hbase4:42773] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 00:01:53,818 INFO [RS:0;jenkins-hbase4:44515] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 00:01:53,822 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37611,1695427312292-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,822 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44515,1695427312235-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,822 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42773,1695427312328-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:53,847 INFO [RS:0;jenkins-hbase4:44515] regionserver.Replication(203): jenkins-hbase4.apache.org,44515,1695427312235 started 2023-09-23 00:01:53,847 INFO [RS:2;jenkins-hbase4:42773] regionserver.Replication(203): jenkins-hbase4.apache.org,42773,1695427312328 started 2023-09-23 00:01:53,847 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44515,1695427312235, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44515, sessionid=0x100d616e9310001 2023-09-23 00:01:53,847 INFO [RS:1;jenkins-hbase4:37611] regionserver.Replication(203): jenkins-hbase4.apache.org,37611,1695427312292 started 2023-09-23 00:01:53,847 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42773,1695427312328, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42773, sessionid=0x100d616e9310003 2023-09-23 00:01:53,847 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37611,1695427312292, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37611, sessionid=0x100d616e9310002 2023-09-23 00:01:53,848 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 00:01:53,848 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 00:01:53,848 DEBUG [RS:2;jenkins-hbase4:42773] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,848 DEBUG [RS:0;jenkins-hbase4:44515] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,848 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 00:01:53,848 DEBUG [RS:0;jenkins-hbase4:44515] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44515,1695427312235' 2023-09-23 00:01:53,848 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42773,1695427312328' 2023-09-23 00:01:53,849 DEBUG [RS:0;jenkins-hbase4:44515] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 00:01:53,849 DEBUG [RS:1;jenkins-hbase4:37611] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,849 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 00:01:53,849 DEBUG [RS:1;jenkins-hbase4:37611] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37611,1695427312292' 2023-09-23 00:01:53,850 DEBUG [RS:1;jenkins-hbase4:37611] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 00:01:53,850 DEBUG [RS:0;jenkins-hbase4:44515] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 00:01:53,850 DEBUG [RS:1;jenkins-hbase4:37611] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 00:01:53,850 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 00:01:53,851 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 00:01:53,851 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 00:01:53,851 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 00:01:53,851 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 00:01:53,851 DEBUG [RS:2;jenkins-hbase4:42773] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:53,851 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 00:01:53,851 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42773,1695427312328' 2023-09-23 00:01:53,851 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 00:01:53,852 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:01:53,851 DEBUG [RS:1;jenkins-hbase4:37611] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:01:53,852 DEBUG [RS:1;jenkins-hbase4:37611] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37611,1695427312292' 2023-09-23 00:01:53,852 DEBUG [RS:1;jenkins-hbase4:37611] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:01:53,852 DEBUG [RS:0;jenkins-hbase4:44515] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:53,852 DEBUG [RS:0;jenkins-hbase4:44515] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44515,1695427312235' 2023-09-23 00:01:53,852 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:01:53,852 DEBUG [RS:0;jenkins-hbase4:44515] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:01:53,853 DEBUG [RS:1;jenkins-hbase4:37611] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:01:53,853 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 00:01:53,853 INFO [RS:2;jenkins-hbase4:42773] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 00:01:53,853 DEBUG [RS:0;jenkins-hbase4:44515] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:01:53,853 INFO [RS:2;jenkins-hbase4:42773] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 00:01:53,854 DEBUG [RS:1;jenkins-hbase4:37611] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 00:01:53,854 INFO [RS:1;jenkins-hbase4:37611] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 00:01:53,854 INFO [RS:1;jenkins-hbase4:37611] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 00:01:53,854 DEBUG [RS:0;jenkins-hbase4:44515] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 00:01:53,855 INFO [RS:0;jenkins-hbase4:44515] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 00:01:53,855 INFO [RS:0;jenkins-hbase4:44515] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 00:01:53,870 DEBUG [jenkins-hbase4:44537] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-23 00:01:53,874 DEBUG [jenkins-hbase4:44537] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:01:53,880 DEBUG [jenkins-hbase4:44537] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:01:53,880 DEBUG [jenkins-hbase4:44537] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:01:53,881 DEBUG [jenkins-hbase4:44537] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:01:53,881 DEBUG [jenkins-hbase4:44537] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:01:53,883 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42773,1695427312328, state=OPENING 2023-09-23 00:01:53,891 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-23 00:01:53,892 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:53,893 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 00:01:53,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:01:53,965 INFO [RS:0;jenkins-hbase4:44515] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44515%2C1695427312235, suffix=, logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,44515,1695427312235, archiveDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs, maxLogs=32 2023-09-23 00:01:53,967 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42773%2C1695427312328, suffix=, logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,42773,1695427312328, archiveDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs, maxLogs=32 2023-09-23 00:01:53,965 INFO [RS:1;jenkins-hbase4:37611] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37611%2C1695427312292, suffix=, logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,37611,1695427312292, archiveDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs, maxLogs=32 2023-09-23 00:01:53,992 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK] 2023-09-23 00:01:53,992 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK] 2023-09-23 00:01:53,993 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK] 2023-09-23 00:01:54,007 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK] 2023-09-23 00:01:54,007 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK] 2023-09-23 00:01:54,007 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK] 2023-09-23 00:01:54,010 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK] 2023-09-23 00:01:54,010 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK] 2023-09-23 00:01:54,011 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK] 2023-09-23 00:01:54,012 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,42773,1695427312328/jenkins-hbase4.apache.org%2C42773%2C1695427312328.1695427313970 2023-09-23 00:01:54,019 DEBUG [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK], DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK], DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK]] 2023-09-23 00:01:54,024 INFO [RS:1;jenkins-hbase4:37611] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,37611,1695427312292/jenkins-hbase4.apache.org%2C37611%2C1695427312292.1695427313971 2023-09-23 00:01:54,024 INFO [RS:0;jenkins-hbase4:44515] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,44515,1695427312235/jenkins-hbase4.apache.org%2C44515%2C1695427312235.1695427313971 2023-09-23 00:01:54,025 DEBUG [RS:1;jenkins-hbase4:37611] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK], DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK]] 2023-09-23 00:01:54,025 DEBUG [RS:0;jenkins-hbase4:44515] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK], DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK], DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK]] 2023-09-23 00:01:54,083 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:54,086 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 00:01:54,089 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 00:01:54,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-23 00:01:54,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 00:01:54,105 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42773%2C1695427312328.meta, suffix=.meta, logDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,42773,1695427312328, archiveDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs, maxLogs=32 2023-09-23 00:01:54,124 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK] 2023-09-23 00:01:54,125 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK] 2023-09-23 00:01:54,128 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK] 2023-09-23 00:01:54,135 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/WALs/jenkins-hbase4.apache.org,42773,1695427312328/jenkins-hbase4.apache.org%2C42773%2C1695427312328.meta.1695427314106.meta 2023-09-23 00:01:54,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44687,DS-3abd59aa-3de7-452a-b8da-174d7f353daa,DISK], DatanodeInfoWithStorage[127.0.0.1:35647,DS-351d42e8-5bf8-426b-b514-bf1a075f3700,DISK], DatanodeInfoWithStorage[127.0.0.1:37479,DS-f868bad1-abef-41f6-97e2-de9597c9cdf9,DISK]] 2023-09-23 00:01:54,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-23 00:01:54,137 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-23 00:01:54,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:54,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-23 00:01:54,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-23 00:01:54,147 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-23 00:01:54,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-23 00:01:54,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:54,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-23 00:01:54,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-23 00:01:54,165 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 00:01:54,167 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/info 2023-09-23 00:01:54,167 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/info 2023-09-23 00:01:54,167 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 00:01:54,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:54,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 00:01:54,170 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/rep_barrier 2023-09-23 00:01:54,170 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/rep_barrier 2023-09-23 00:01:54,171 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 00:01:54,172 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:54,172 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 00:01:54,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/table 2023-09-23 00:01:54,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/table 2023-09-23 00:01:54,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 00:01:54,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:54,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740 2023-09-23 00:01:54,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740 2023-09-23 00:01:54,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 00:01:54,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 00:01:54,188 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74664697, jitterRate=0.11259068548679352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 00:01:54,191 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 00:01:54,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695427314075 2023-09-23 00:01:54,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-23 00:01:54,219 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-23 00:01:54,220 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42773,1695427312328, state=OPEN 2023-09-23 00:01:54,223 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-23 00:01:54,223 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 00:01:54,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-23 00:01:54,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42773,1695427312328 in 326 msec 2023-09-23 00:01:54,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-23 00:01:54,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 539 msec 2023-09-23 00:01:54,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 782 msec 2023-09-23 00:01:54,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695427314239, completionTime=-1 2023-09-23 00:01:54,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-23 00:01:54,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-23 00:01:54,310 DEBUG [hconnection-0x56cfdced-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:01:54,314 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:01:54,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-23 00:01:54,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695427374343 2023-09-23 00:01:54,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695427434343 2023-09-23 00:01:54,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 103 msec 2023-09-23 00:01:54,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44537,1695427310899-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:54,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44537,1695427310899-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:54,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44537,1695427310899-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:54,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44537, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:54,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-23 00:01:54,401 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-23 00:01:54,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-23 00:01:54,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 00:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-23 00:01:54,425 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:01:54,429 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:01:54,451 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77 empty. 2023-09-23 00:01:54,455 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-23 00:01:54,531 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-23 00:01:54,534 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 54ceb846fedecd81fc9168579357ca77, NAME => 'hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:01:54,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:54,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 54ceb846fedecd81fc9168579357ca77, disabling compactions & flushes 2023-09-23 00:01:54,552 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. after waiting 0 ms 2023-09-23 00:01:54,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,552 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,553 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 54ceb846fedecd81fc9168579357ca77: 2023-09-23 00:01:54,557 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:01:54,578 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695427314562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427314562"}]},"ts":"1695427314562"} 2023-09-23 00:01:54,608 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 00:01:54,610 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:01:54,616 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427314611"}]},"ts":"1695427314611"} 2023-09-23 00:01:54,620 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-23 00:01:54,624 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:01:54,625 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:01:54,625 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:01:54,625 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:01:54,625 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:01:54,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=54ceb846fedecd81fc9168579357ca77, ASSIGN}] 2023-09-23 00:01:54,630 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=54ceb846fedecd81fc9168579357ca77, ASSIGN 2023-09-23 00:01:54,632 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=54ceb846fedecd81fc9168579357ca77, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44515,1695427312235; forceNewPlan=false, retain=false 2023-09-23 00:01:54,785 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 00:01:54,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=54ceb846fedecd81fc9168579357ca77, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:54,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695427314786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427314786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427314786"}]},"ts":"1695427314786"} 2023-09-23 00:01:54,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 54ceb846fedecd81fc9168579357ca77, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:01:54,947 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:54,947 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 00:01:54,950 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 00:01:54,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 54ceb846fedecd81fc9168579357ca77, NAME => 'hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.', STARTKEY => '', ENDKEY => ''} 2023-09-23 00:01:54,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. service=AccessControlService 2023-09-23 00:01:54,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:54,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:54,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,961 INFO [StoreOpener-54ceb846fedecd81fc9168579357ca77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,963 DEBUG [StoreOpener-54ceb846fedecd81fc9168579357ca77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/info 2023-09-23 00:01:54,964 DEBUG [StoreOpener-54ceb846fedecd81fc9168579357ca77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/info 2023-09-23 00:01:54,964 INFO [StoreOpener-54ceb846fedecd81fc9168579357ca77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54ceb846fedecd81fc9168579357ca77 columnFamilyName info 2023-09-23 00:01:54,965 INFO [StoreOpener-54ceb846fedecd81fc9168579357ca77-1] regionserver.HStore(310): Store=54ceb846fedecd81fc9168579357ca77/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:54,966 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:01:54,975 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:01:54,976 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 54ceb846fedecd81fc9168579357ca77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61667782, jitterRate=-0.081078439950943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:01:54,976 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 54ceb846fedecd81fc9168579357ca77: 2023-09-23 00:01:54,978 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77., pid=6, masterSystemTime=1695427314947 2023-09-23 00:01:54,982 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,983 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:01:54,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=54ceb846fedecd81fc9168579357ca77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:01:54,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695427314983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427314983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427314983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427314983"}]},"ts":"1695427314983"} 2023-09-23 00:01:54,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-23 00:01:54,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 54ceb846fedecd81fc9168579357ca77, server=jenkins-hbase4.apache.org,44515,1695427312235 in 194 msec 2023-09-23 00:01:54,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-23 00:01:54,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=54ceb846fedecd81fc9168579357ca77, ASSIGN in 364 msec 2023-09-23 00:01:54,997 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:01:54,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427314997"}]},"ts":"1695427314997"} 2023-09-23 00:01:55,000 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-23 00:01:55,004 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:01:55,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 590 msec 2023-09-23 00:01:55,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-23 00:01:55,028 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-23 00:01:55,028 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:01:55,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:01:55,053 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:01:55,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-23 00:01:55,083 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 00:01:55,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-09-23 00:01:55,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-23 00:01:55,113 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 00:01:55,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-23 00:01:55,125 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-23 00:01:55,128 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-23 00:01:55,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.733sec 2023-09-23 00:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-23 00:01:55,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-23 00:01:55,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-23 00:01:55,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44537,1695427310899-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-23 00:01:55,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44537,1695427310899-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-23 00:01:55,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 00:01:55,157 DEBUG [Listener at localhost/39051] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:01:55,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-23 00:01:55,162 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:01:55,163 DEBUG [Listener at localhost/39051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:01:55,167 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:01:55,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-23 00:01:55,172 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,173 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b empty. 2023-09-23 00:01:55,175 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,175 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-23 00:01:55,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 00:01:55,183 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:01:55,202 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:01:55,203 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-23 00:01:55,205 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ec7f95e24c47cf2a83f9488644c522b, NAME => 'hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:01:55,206 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:01:55,206 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-23 00:01:55,206 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/test.cache.data in system properties and HBase conf 2023-09-23 00:01:55,206 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 00:01:55,206 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop.log.dir in system properties and HBase conf 2023-09-23 00:01:55,206 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 00:01:55,207 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/nfs.dump.dir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 00:01:55,208 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 00:01:55,209 INFO [Listener at localhost/39051] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-23 00:01:55,231 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:55,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2ec7f95e24c47cf2a83f9488644c522b, disabling compactions & flushes 2023-09-23 00:01:55,233 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. after waiting 0 ms 2023-09-23 00:01:55,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,233 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2ec7f95e24c47cf2a83f9488644c522b: 2023-09-23 00:01:55,237 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:01:55,239 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695427315238"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427315238"}]},"ts":"1695427315238"} 2023-09-23 00:01:55,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 00:01:55,243 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:01:55,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427315243"}]},"ts":"1695427315243"} 2023-09-23 00:01:55,245 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-23 00:01:55,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:01:55,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:01:55,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:01:55,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:01:55,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:01:55,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2ec7f95e24c47cf2a83f9488644c522b, ASSIGN}] 2023-09-23 00:01:55,259 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2ec7f95e24c47cf2a83f9488644c522b, ASSIGN 2023-09-23 00:01:55,260 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2ec7f95e24c47cf2a83f9488644c522b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:01:55,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 00:01:55,411 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 00:01:55,412 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2ec7f95e24c47cf2a83f9488644c522b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:55,412 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695427315411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427315411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427315411"}]},"ts":"1695427315411"} 2023-09-23 00:01:55,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2ec7f95e24c47cf2a83f9488644c522b, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:01:55,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 00:01:55,576 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ec7f95e24c47cf2a83f9488644c522b, NAME => 'hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.', STARTKEY => '', ENDKEY => ''} 2023-09-23 00:01:55,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. service=AccessControlService 2023-09-23 00:01:55,577 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:01:55,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:55,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,580 INFO [StoreOpener-2ec7f95e24c47cf2a83f9488644c522b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,582 DEBUG [StoreOpener-2ec7f95e24c47cf2a83f9488644c522b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/l 2023-09-23 00:01:55,583 DEBUG [StoreOpener-2ec7f95e24c47cf2a83f9488644c522b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/l 2023-09-23 00:01:55,583 INFO [StoreOpener-2ec7f95e24c47cf2a83f9488644c522b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ec7f95e24c47cf2a83f9488644c522b columnFamilyName l 2023-09-23 00:01:55,584 INFO [StoreOpener-2ec7f95e24c47cf2a83f9488644c522b-1] regionserver.HStore(310): Store=2ec7f95e24c47cf2a83f9488644c522b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:01:55,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:01:55,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:01:55,599 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2ec7f95e24c47cf2a83f9488644c522b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69080830, jitterRate=0.029384583234786987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:01:55,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2ec7f95e24c47cf2a83f9488644c522b: 2023-09-23 00:01:55,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b., pid=11, masterSystemTime=1695427315569 2023-09-23 00:01:55,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,604 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:01:55,605 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2ec7f95e24c47cf2a83f9488644c522b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:01:55,605 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695427315605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427315605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427315605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427315605"}]},"ts":"1695427315605"} 2023-09-23 00:01:55,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-23 00:01:55,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2ec7f95e24c47cf2a83f9488644c522b, server=jenkins-hbase4.apache.org,42773,1695427312328 in 193 msec 2023-09-23 00:01:55,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-23 00:01:55,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2ec7f95e24c47cf2a83f9488644c522b, ASSIGN in 357 msec 2023-09-23 00:01:55,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:01:55,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427315619"}]},"ts":"1695427315619"} 2023-09-23 00:01:55,622 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-23 00:01:55,626 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:01:55,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 469 msec 2023-09-23 00:01:55,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 00:01:55,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-23 00:01:55,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-23 00:01:56,400 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:56,759 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:56,770 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41083_jobhistory____.quzqvd/webapp 2023-09-23 00:01:56,945 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-23 00:01:56,945 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-23 00:01:56,945 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 00:01:56,948 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 00:01:57,033 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:57,359 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:57,680 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-23 00:01:57,713 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41083 2023-09-23 00:01:57,897 WARN [Listener at jenkins-hbase4.apache.org/44593] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:58,185 WARN [Listener at jenkins-hbase4.apache.org/44593] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 00:01:58,186 INFO [Listener at jenkins-hbase4.apache.org/44593] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:58,193 INFO [Listener at jenkins-hbase4.apache.org/44593] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46125_cluster____.x0ma6m/webapp 2023-09-23 00:01:58,264 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 00:01:58,264 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-23 00:01:58,264 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 00:01:58,265 INFO [Listener at jenkins-hbase4.apache.org/44593] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 00:01:58,275 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:58,481 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:58,611 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:58,625 INFO [Listener at jenkins-hbase4.apache.org/44593] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46125 2023-09-23 00:01:59,141 WARN [Listener at jenkins-hbase4.apache.org/40051] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:59,167 WARN [Listener at jenkins-hbase4.apache.org/40051] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 00:01:59,168 INFO [Listener at jenkins-hbase4.apache.org/40051] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:59,190 INFO [Listener at jenkins-hbase4.apache.org/40051] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38313_node____srakpa/webapp 2023-09-23 00:01:59,271 INFO [Listener at jenkins-hbase4.apache.org/40051] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 00:01:59,272 INFO [Listener at jenkins-hbase4.apache.org/40051] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 00:01:59,272 INFO [Listener at jenkins-hbase4.apache.org/40051] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 00:01:59,272 INFO [Listener at jenkins-hbase4.apache.org/40051] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 00:01:59,284 INFO [Listener at jenkins-hbase4.apache.org/40051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:59,305 INFO [Listener at jenkins-hbase4.apache.org/40051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:59,400 INFO [Listener at jenkins-hbase4.apache.org/40051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:59,412 INFO [Listener at jenkins-hbase4.apache.org/40051] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38313 2023-09-23 00:01:59,567 WARN [Listener at jenkins-hbase4.apache.org/40639] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 00:01:59,575 WARN [Listener at jenkins-hbase4.apache.org/40639] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 00:01:59,575 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 00:01:59,582 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42793_node____8aajrl/webapp 2023-09-23 00:01:59,632 INFO [Listener at jenkins-hbase4.apache.org/40639] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 00:01:59,632 INFO [Listener at jenkins-hbase4.apache.org/40639] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 00:01:59,633 INFO [Listener at jenkins-hbase4.apache.org/40639] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 00:01:59,633 INFO [Listener at jenkins-hbase4.apache.org/40639] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 00:01:59,640 INFO [Listener at jenkins-hbase4.apache.org/40639] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:59,658 INFO [Listener at jenkins-hbase4.apache.org/40639] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:59,719 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:01:59,729 INFO [Listener at jenkins-hbase4.apache.org/40639] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 00:01:59,757 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42793 2023-09-23 00:01:59,797 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-23 00:01:59,799 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:01:59,868 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=108, ProcessCount=168, AvailableMemoryMB=2410 2023-09-23 00:01:59,868 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-23 00:01:59,886 DEBUG [Listener at jenkins-hbase4.apache.org/40639] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-23 00:01:59,892 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-23 00:01:59,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 00:01:59,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:01:59,912 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:01:59,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-23 00:01:59,915 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:01:59,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 00:01:59,922 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 2023-09-23 00:01:59,924 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 empty. 2023-09-23 00:01:59,925 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 2023-09-23 00:01:59,925 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-23 00:01:59,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 2023-09-23 00:01:59,926 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 empty. 2023-09-23 00:01:59,928 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-23 00:01:59,929 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 2023-09-23 00:01:59,929 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 00:01:59,929 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-23 00:01:59,962 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-23 00:01:59,963 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => d368cac4e6e753d11f5570f01beae151, NAME => 'testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:01:59,964 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e5854152e5d1ba055ba173cac847c673, NAME => 'testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:01:59,995 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:01:59,995 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e5854152e5d1ba055ba173cac847c673, disabling compactions & flushes 2023-09-23 00:01:59,995 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:01:59,995 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:01:59,995 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. after waiting 0 ms 2023-09-23 00:01:59,995 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:01:59,995 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:01:59,995 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e5854152e5d1ba055ba173cac847c673: 2023-09-23 00:01:59,999 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:00,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing d368cac4e6e753d11f5570f01beae151, disabling compactions & flushes 2023-09-23 00:02:00,000 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. after waiting 0 ms 2023-09-23 00:02:00,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,000 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for d368cac4e6e753d11f5570f01beae151: 2023-09-23 00:02:00,004 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:02:00,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427320005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427320005"}]},"ts":"1695427320005"} 2023-09-23 00:02:00,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427320005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427320005"}]},"ts":"1695427320005"} 2023-09-23 00:02:00,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 00:02:00,053 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:02:00,055 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:02:00,055 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427320055"}]},"ts":"1695427320055"} 2023-09-23 00:02:00,057 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-23 00:02:00,063 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:02:00,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:02:00,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:02:00,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:02:00,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:02:00,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, ASSIGN}] 2023-09-23 00:02:00,069 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, ASSIGN 2023-09-23 00:02:00,069 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, ASSIGN 2023-09-23 00:02:00,071 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:02:00,071 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44515,1695427312235; forceNewPlan=false, retain=false 2023-09-23 00:02:00,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 00:02:00,221 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:02:00,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e5854152e5d1ba055ba173cac847c673, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:00,224 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d368cac4e6e753d11f5570f01beae151, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:00,224 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427320224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427320224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427320224"}]},"ts":"1695427320224"} 2023-09-23 00:02:00,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427320224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427320224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427320224"}]},"ts":"1695427320224"} 2023-09-23 00:02:00,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure e5854152e5d1ba055ba173cac847c673, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:02:00,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure d368cac4e6e753d11f5570f01beae151, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:02:00,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:00,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5854152e5d1ba055ba173cac847c673, NAME => 'testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 00:02:00,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d368cac4e6e753d11f5570f01beae151, NAME => 'testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 00:02:00,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. service=AccessControlService 2023-09-23 00:02:00,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. service=AccessControlService 2023-09-23 00:02:00,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:02:00,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,397 INFO [StoreOpener-d368cac4e6e753d11f5570f01beae151-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,398 INFO [StoreOpener-e5854152e5d1ba055ba173cac847c673-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,399 DEBUG [StoreOpener-d368cac4e6e753d11f5570f01beae151-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf 2023-09-23 00:02:00,399 DEBUG [StoreOpener-d368cac4e6e753d11f5570f01beae151-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf 2023-09-23 00:02:00,400 DEBUG [StoreOpener-e5854152e5d1ba055ba173cac847c673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf 2023-09-23 00:02:00,400 DEBUG [StoreOpener-e5854152e5d1ba055ba173cac847c673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf 2023-09-23 00:02:00,403 INFO [StoreOpener-e5854152e5d1ba055ba173cac847c673-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5854152e5d1ba055ba173cac847c673 columnFamilyName cf 2023-09-23 00:02:00,403 INFO [StoreOpener-d368cac4e6e753d11f5570f01beae151-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d368cac4e6e753d11f5570f01beae151 columnFamilyName cf 2023-09-23 00:02:00,406 INFO [StoreOpener-e5854152e5d1ba055ba173cac847c673-1] regionserver.HStore(310): Store=e5854152e5d1ba055ba173cac847c673/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:02:00,406 INFO [StoreOpener-d368cac4e6e753d11f5570f01beae151-1] regionserver.HStore(310): Store=d368cac4e6e753d11f5570f01beae151/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:02:00,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:00,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:00,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:02:00,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:02:00,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5854152e5d1ba055ba173cac847c673; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62060287, jitterRate=-0.07522965967655182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:02:00,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d368cac4e6e753d11f5570f01beae151; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72605036, jitterRate=0.08189934492111206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:02:00,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5854152e5d1ba055ba173cac847c673: 2023-09-23 00:02:00,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d368cac4e6e753d11f5570f01beae151: 2023-09-23 00:02:00,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673., pid=15, masterSystemTime=1695427320380 2023-09-23 00:02:00,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151., pid=16, masterSystemTime=1695427320383 2023-09-23 00:02:00,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:00,435 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d368cac4e6e753d11f5570f01beae151, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:00,435 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427320434"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427320434"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427320434"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427320434"}]},"ts":"1695427320434"} 2023-09-23 00:02:00,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:00,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:00,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e5854152e5d1ba055ba173cac847c673, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:00,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427320436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427320436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427320436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427320436"}]},"ts":"1695427320436"} 2023-09-23 00:02:00,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-23 00:02:00,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure d368cac4e6e753d11f5570f01beae151, server=jenkins-hbase4.apache.org,44515,1695427312235 in 211 msec 2023-09-23 00:02:00,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-23 00:02:00,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure e5854152e5d1ba055ba173cac847c673, server=jenkins-hbase4.apache.org,42773,1695427312328 in 214 msec 2023-09-23 00:02:00,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, ASSIGN in 376 msec 2023-09-23 00:02:00,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-23 00:02:00,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, ASSIGN in 379 msec 2023-09-23 00:02:00,449 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:02:00,449 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427320449"}]},"ts":"1695427320449"} 2023-09-23 00:02:00,451 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-23 00:02:00,455 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:02:00,460 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-23 00:02:00,476 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 00:02:00,507 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:00,507 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:00,507 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:00,507 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:00,507 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:02:00,515 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:00,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:00,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:00,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:00,519 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:00,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 00:02:00,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 610 msec 2023-09-23 00:02:01,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 00:02:01,024 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-23 00:02:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 00:02:01,030 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:01,032 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:02:01,060 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:01,063 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:01,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 00:02:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427321092 (current time:1695427321092). 2023-09-23 00:02:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:02:01,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x7864a0f7 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:01,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bd7d557, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:01,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:01,105 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:01,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7864a0f7 to 127.0.0.1:52502 2023-09-23 00:02:01,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:01,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x054f55a7 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:01,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fd44d74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:01,118 DEBUG [hconnection-0x4be710c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:01,120 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x054f55a7 to 127.0.0.1:52502 2023-09-23 00:02:01,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:01,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 00:02:01,131 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:01,131 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-23 00:02:01,131 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:01,131 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-23 00:02:01,132 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 00:02:01,132 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-23 00:02:01,132 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:01,132 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-23 00:02:01,132 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 00:02:01,132 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-23 00:02:01,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:02:01,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 00:02:01,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 00:02:01,175 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 00:02:01,176 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695427921176 2023-09-23 00:02:01,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 00:02:01,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 00:02:01,179 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 00:02:01,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 00:02:01,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-23 00:02:01,183 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 00:02:01,184 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695427921184 2023-09-23 00:02:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:02:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:02:01,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,213 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-23 00:02:01,213 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,214 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 00:02:01,214 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 00:02:01,215 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,215 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,221 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,221 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,221 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,221 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,222 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,223 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,223 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,223 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 00:02:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 00:02:01,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 00:02:01,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 00:02:01,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,230 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 00:02:01,230 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,230 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 00:02:01,231 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 00:02:01,231 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,231 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 00:02:01,232 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 00:02:01,232 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 00:02:01,231 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,232 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 00:02:01,233 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 00:02:01,233 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 00:02:01,233 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 00:02:01,232 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 00:02:01,233 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 00:02:01,235 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,235 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,235 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,236 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:01,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,238 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:01,238 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,238 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:01,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 00:02:01,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb64a88[Count = 1] remaining members to acquire global barrier 2023-09-23 00:02:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 00:02:01,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb64a88[Count = 0] remaining members to acquire global barrier 2023-09-23 00:02:01,243 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 00:02:01,243 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,245 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,245 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,245 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,246 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 00:02:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,246 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 00:02:01,246 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 00:02:01,246 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 00:02:01,246 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:02:01,246 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,247 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,247 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:02:01,247 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:01,247 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:01,247 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:01,247 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:01,247 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:01,247 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:01,247 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. started... 2023-09-23 00:02:01,248 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. started... 2023-09-23 00:02:01,249 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 00:02:01,249 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,249 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 00:02:01,252 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d368cac4e6e753d11f5570f01beae151: 2023-09-23 00:02:01,252 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e5854152e5d1ba055ba173cac847c673: 2023-09-23 00:02:01,253 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,253 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,258 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:01,258 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:01,262 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:02:01,262 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:02:01,285 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:01,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 00:02:01,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:01,303 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. completed. 2023-09-23 00:02:01,303 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:01,304 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:02:01,304 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. completed. 2023-09-23 00:02:01,304 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:02:01,304 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:02:01,306 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 00:02:01,306 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 00:02:01,306 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 00:02:01,307 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,308 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 00:02:01,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44515,1695427312235': 2023-09-23 00:02:01,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 00:02:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:02:01,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 00:02:01,319 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-23 00:02:01,319 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:02:01,319 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:02:01,319 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,319 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:02:01,323 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,323 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,323 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,323 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,323 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,324 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,324 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,324 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,325 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,326 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,328 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,329 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,329 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,343 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,343 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,342 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,343 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 00:02:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:02:01,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,344 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 00:02:01,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 00:02:01,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,412 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:01,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695427321176Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695427321361 (+185 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695427321361Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695427321361Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695427321374 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695427321398 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695427321411 (+13 ms) 2023-09-23 00:02:01,414 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 00:02:01,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 236 msec 2023-09-23 00:02:01,504 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:01,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 00:02:01,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:02:01,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44515] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:02:01,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:02:01,531 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 00:02:01,531 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:01,531 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:02:01,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 00:02:01,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427321546 (current time:1695427321546). 2023-09-23 00:02:01,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:02:01,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x2aed0168 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:01,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7590f97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:01,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:01,558 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:01,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aed0168 to 127.0.0.1:52502 2023-09-23 00:02:01,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:01,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x0fe9e1e5 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:01,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d4d4731, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:01,567 DEBUG [hconnection-0x2a7dcb8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:01,569 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fe9e1e5 to 127.0.0.1:52502 2023-09-23 00:02:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 00:02:01,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:02:01,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 00:02:01,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 00:02:01,579 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 00:02:01,580 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695427921580 2023-09-23 00:02:01,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 00:02:01,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 00:02:01,582 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:02:01,582 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:02:01,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 00:02:01,583 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 00:02:01,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-23 00:02:01,586 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 00:02:01,587 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695427921587 2023-09-23 00:02:01,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-23 00:02:01,606 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-23 00:02:01,606 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,607 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 00:02:01,607 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 00:02:01,607 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,607 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,609 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,609 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,609 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,609 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,610 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,610 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,610 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,610 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:02:01,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 00:02:01,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 00:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 00:02:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 00:02:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 00:02:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 00:02:01,613 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 00:02:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,613 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 00:02:01,613 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 00:02:01,614 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:01,614 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 00:02:01,614 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 00:02:01,615 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 00:02:01,615 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 00:02:01,615 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 00:02:01,615 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 00:02:01,615 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 00:02:01,617 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,617 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,618 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,619 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,619 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:01,619 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,619 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:01,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a63252c[Count = 1] remaining members to acquire global barrier 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 00:02:01,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a63252c[Count = 0] remaining members to acquire global barrier 2023-09-23 00:02:01,624 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 00:02:01,624 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,628 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 00:02:01,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:01,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 00:02:01,629 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,629 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:02:01,629 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:01,629 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. started... 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:01,629 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:01,629 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d368cac4e6e753d11f5570f01beae151 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-23 00:02:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:02:01,630 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. started... 2023-09-23 00:02:01,630 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e5854152e5d1ba055ba173cac847c673 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-23 00:02:01,632 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 00:02:01,632 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,632 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 00:02:01,682 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:01,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 00:02:01,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:01,684 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:02:01,758 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923ac64e7738f8b447196118f504cfda174 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923ac64e7738f8b447196118f504cfda174 2023-09-23 00:02:01,758 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309230e1cbee17b42412689578cbe1a678eea to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309230e1cbee17b42412689578cbe1a678eea 2023-09-23 00:02:01,796 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/.tmp/cf/d814b5bc6ab249739f722d6a7e9e5d45 2023-09-23 00:02:01,798 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/.tmp/cf/eb25881690c141a49d48a4c0473deb17 2023-09-23 00:02:01,808 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/.tmp/cf/d814b5bc6ab249739f722d6a7e9e5d45 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf/d814b5bc6ab249739f722d6a7e9e5d45 2023-09-23 00:02:01,808 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/.tmp/cf/eb25881690c141a49d48a4c0473deb17 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf/eb25881690c141a49d48a4c0473deb17 2023-09-23 00:02:01,818 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf/d814b5bc6ab249739f722d6a7e9e5d45, entries=49, sequenceid=6, filesize=13.1 K 2023-09-23 00:02:01,821 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf/eb25881690c141a49d48a4c0473deb17, entries=1, sequenceid=6, filesize=5.1 K 2023-09-23 00:02:01,823 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for e5854152e5d1ba055ba173cac847c673 in 193ms, sequenceid=6, compaction requested=false 2023-09-23 00:02:01,823 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-23 00:02:01,824 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for d368cac4e6e753d11f5570f01beae151 in 195ms, sequenceid=6, compaction requested=false 2023-09-23 00:02:01,825 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e5854152e5d1ba055ba173cac847c673: 2023-09-23 00:02:01,825 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d368cac4e6e753d11f5570f01beae151: 2023-09-23 00:02:01,825 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 00:02:01,825 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:01,826 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf/d814b5bc6ab249739f722d6a7e9e5d45] hfiles 2023-09-23 00:02:01,826 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf/d814b5bc6ab249739f722d6a7e9e5d45 for snapshot=snaptb0-testExportWithTargetName 2023-09-23 00:02:01,826 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 00:02:01,826 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:01,826 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf/eb25881690c141a49d48a4c0473deb17] hfiles 2023-09-23 00:02:01,826 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf/eb25881690c141a49d48a4c0473deb17 for snapshot=snaptb0-testExportWithTargetName 2023-09-23 00:02:01,854 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. completed. 2023-09-23 00:02:01,854 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 00:02:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:02:01,857 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 00:02:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,858 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 00:02:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,860 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. completed. 2023-09-23 00:02:01,860 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 00:02:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:02:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,862 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,862 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 00:02:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 00:02:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:02:01,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 00:02:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44515,1695427312235': 2023-09-23 00:02:01,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 00:02:01,871 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-23 00:02:01,871 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:02:01,871 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:02:01,871 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-23 00:02:01,871 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:02:01,877 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,877 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,877 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:01,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,877 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,877 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,877 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,878 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:01,878 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,879 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,880 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:01,882 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 00:02:01,883 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,883 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,884 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:01,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 00:02:01,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:01,891 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:01,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:01,896 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-23 00:02:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:01,896 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 00:02:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,898 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:01,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923ac64e7738f8b447196118f504cfda174, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309230e1cbee17b42412689578cbe1a678eea] mob files 2023-09-23 00:02:01,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923ac64e7738f8b447196118f504cfda174 2023-09-23 00:02:01,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309230e1cbee17b42412689578cbe1a678eea 2023-09-23 00:02:01,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-23 00:02:01,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,956 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 00:02:01,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,956 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 00:02:01,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695427321580Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695427321918 (+338 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695427321918Loading Region manifests for snaptb0-testExportWithTargetName at 1695427321918Writing data manifest for snaptb0-testExportWithTargetName at 1695427321924 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695427321943 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695427321956 (+13 ms) 2023-09-23 00:02:01,959 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 00:02:01,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 378 msec 2023-09-23 00:02:02,194 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:02,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 00:02:02,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:02:02,198 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198 2023-09-23 00:02:02,199 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33037, tgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198, rawTgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:02,241 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:02,241 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656004694_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 00:02:02,241 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-23 00:02:02,260 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 00:02:02,734 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:02,735 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:02,735 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:02,736 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,686 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-8907082727834105241.jar 2023-09-23 00:02:03,687 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,687 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,755 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-4812969664986916850.jar 2023-09-23 00:02:03,755 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,756 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,756 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,757 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,757 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,758 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:03,758 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:02:03,759 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:02:03,759 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:02:03,760 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:02:03,760 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:02:03,761 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:02:03,761 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:02:03,762 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:02:03,763 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:02:03,764 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:02:03,769 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:03,769 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:03,771 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:03,772 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:03,772 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:03,773 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:03,774 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:04,554 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:02:04,560 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-23 00:02:04,568 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 00:02:05,026 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:05,027 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:05,693 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0001_000001 (auth:SIMPLE) 2023-09-23 00:02:05,899 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:02:10,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0001_000001 (auth:SIMPLE) 2023-09-23 00:02:12,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0001_000001 (auth:SIMPLE) 2023-09-23 00:02:15,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0001_000001 (auth:SIMPLE) 2023-09-23 00:02:16,420 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:02:16,423 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:02:16,434 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-23 00:02:16,435 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:02:16,435 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:02:16,435 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 00:02:16,436 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-23 00:02:16,436 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-23 00:02:16,436 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198/.hbase-snapshot/testExportWithTargetName 2023-09-23 00:02:16,437 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-23 00:02:16,437 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427322198/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-23 00:02:16,448 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-23 00:02:16,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-23 00:02:16,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:16,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427336467"}]},"ts":"1695427336467"} 2023-09-23 00:02:16,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 00:02:16,469 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-23 00:02:16,471 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-23 00:02:16,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, UNASSIGN}] 2023-09-23 00:02:16,475 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, UNASSIGN 2023-09-23 00:02:16,476 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, UNASSIGN 2023-09-23 00:02:16,477 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d368cac4e6e753d11f5570f01beae151, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:16,477 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e5854152e5d1ba055ba173cac847c673, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:16,477 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427336477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427336477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427336477"}]},"ts":"1695427336477"} 2023-09-23 00:02:16,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427336477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427336477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427336477"}]},"ts":"1695427336477"} 2023-09-23 00:02:16,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e5854152e5d1ba055ba173cac847c673, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:02:16,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure d368cac4e6e753d11f5570f01beae151, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:02:16,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 00:02:16,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:16,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5854152e5d1ba055ba173cac847c673, disabling compactions & flushes 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d368cac4e6e753d11f5570f01beae151, disabling compactions & flushes 2023-09-23 00:02:16,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:16,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. after waiting 0 ms 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. after waiting 0 ms 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:16,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:02:16,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:02:16,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:16,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:16,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673. 2023-09-23 00:02:16,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151. 2023-09-23 00:02:16,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5854152e5d1ba055ba173cac847c673: 2023-09-23 00:02:16,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d368cac4e6e753d11f5570f01beae151: 2023-09-23 00:02:16,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:16,668 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e5854152e5d1ba055ba173cac847c673, regionState=CLOSED 2023-09-23 00:02:16,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:16,668 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427336668"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427336668"}]},"ts":"1695427336668"} 2023-09-23 00:02:16,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d368cac4e6e753d11f5570f01beae151, regionState=CLOSED 2023-09-23 00:02:16,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695427336669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427336669"}]},"ts":"1695427336669"} 2023-09-23 00:02:16,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-23 00:02:16,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e5854152e5d1ba055ba173cac847c673, server=jenkins-hbase4.apache.org,42773,1695427312328 in 191 msec 2023-09-23 00:02:16,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-23 00:02:16,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure d368cac4e6e753d11f5570f01beae151, server=jenkins-hbase4.apache.org,44515,1695427312235 in 192 msec 2023-09-23 00:02:16,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e5854152e5d1ba055ba173cac847c673, UNASSIGN in 201 msec 2023-09-23 00:02:16,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-23 00:02:16,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d368cac4e6e753d11f5570f01beae151, UNASSIGN in 202 msec 2023-09-23 00:02:16,679 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427336678"}]},"ts":"1695427336678"} 2023-09-23 00:02:16,680 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-23 00:02:16,682 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-23 00:02:16,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 228 msec 2023-09-23 00:02:16,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 00:02:16,771 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-23 00:02:16,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-23 00:02:16,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:16,787 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:16,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-23 00:02:16,790 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:16,793 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-23 00:02:16,796 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:16,796 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:16,799 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/recovered.edits] 2023-09-23 00:02:16,799 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/recovered.edits] 2023-09-23 00:02:16,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf/eb25881690c141a49d48a4c0473deb17 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/cf/eb25881690c141a49d48a4c0473deb17 2023-09-23 00:02:16,807 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf/d814b5bc6ab249739f722d6a7e9e5d45 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/cf/d814b5bc6ab249739f722d6a7e9e5d45 2023-09-23 00:02:16,811 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151/recovered.edits/9.seqid 2023-09-23 00:02:16,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673/recovered.edits/9.seqid 2023-09-23 00:02:16,812 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/d368cac4e6e753d11f5570f01beae151 2023-09-23 00:02:16,812 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportWithTargetName/e5854152e5d1ba055ba173cac847c673 2023-09-23 00:02:16,812 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 00:02:16,813 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 00:02:16,814 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-23 00:02:16,818 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923ac64e7738f8b447196118f504cfda174 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923ac64e7738f8b447196118f504cfda174 2023-09-23 00:02:16,820 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309230e1cbee17b42412689578cbe1a678eea to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309230e1cbee17b42412689578cbe1a678eea 2023-09-23 00:02:16,820 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 00:02:16,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:16,845 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-23 00:02:16,949 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:16,950 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:16,949 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:16,949 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:16,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-23 00:02:16,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-23 00:02:16,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-23 00:02:16,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-23 00:02:16,953 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-23 00:02:16,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:16,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-23 00:02:16,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427336954"}]},"ts":"9223372036854775807"} 2023-09-23 00:02:16,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427336954"}]},"ts":"9223372036854775807"} 2023-09-23 00:02:16,957 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 00:02:16,957 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d368cac4e6e753d11f5570f01beae151, NAME => 'testtb-testExportWithTargetName,,1695427319905.d368cac4e6e753d11f5570f01beae151.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e5854152e5d1ba055ba173cac847c673, NAME => 'testtb-testExportWithTargetName,1,1695427319905.e5854152e5d1ba055ba173cac847c673.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 00:02:16,957 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-23 00:02:16,957 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427336957"}]},"ts":"9223372036854775807"} 2023-09-23 00:02:16,959 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,003 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 00:02:17,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 00:02:17,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 280 msec 2023-09-23 00:02:17,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 00:02:17,108 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-23 00:02:17,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-23 00:02:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-23 00:02:17,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-23 00:02:17,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-23 00:02:17,173 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:50972 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_7974697_1 at /127.0.0.1:60400 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:42963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:40051 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:42421 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_7974697_1 at /127.0.0.1:42876 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:33140 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:49952 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=120 (was 108) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=1652 (was 2410) 2023-09-23 00:02:17,174 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-23 00:02:17,197 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=120, ProcessCount=171, AvailableMemoryMB=1652 2023-09-23 00:02:17,198 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-23 00:02:17,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 00:02:17,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:17,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:02:17,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-23 00:02:17,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:02:17,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 00:02:17,210 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,210 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,210 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 empty. 2023-09-23 00:02:17,210 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 empty. 2023-09-23 00:02:17,211 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,211 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,211 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 00:02:17,226 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 00:02:17,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7f5e5a1bc6c4d39bcf611c66a32e0ed1, NAME => 'testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:02:17,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b8a4ae9bf14814b297193bd62a5d93f6, NAME => 'testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:02:17,255 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:17,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7f5e5a1bc6c4d39bcf611c66a32e0ed1, disabling compactions & flushes 2023-09-23 00:02:17,256 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. after waiting 0 ms 2023-09-23 00:02:17,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,256 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,256 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7f5e5a1bc6c4d39bcf611c66a32e0ed1: 2023-09-23 00:02:17,258 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:17,259 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b8a4ae9bf14814b297193bd62a5d93f6, disabling compactions & flushes 2023-09-23 00:02:17,259 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,259 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,259 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. after waiting 0 ms 2023-09-23 00:02:17,259 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,259 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,260 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b8a4ae9bf14814b297193bd62a5d93f6: 2023-09-23 00:02:17,263 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:02:17,264 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427337264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427337264"}]},"ts":"1695427337264"} 2023-09-23 00:02:17,264 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427337264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427337264"}]},"ts":"1695427337264"} 2023-09-23 00:02:17,266 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:02:17,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:02:17,268 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427337267"}]},"ts":"1695427337267"} 2023-09-23 00:02:17,269 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 00:02:17,273 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:02:17,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:02:17,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:02:17,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:02:17,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:02:17,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, ASSIGN}] 2023-09-23 00:02:17,277 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, ASSIGN 2023-09-23 00:02:17,277 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, ASSIGN 2023-09-23 00:02:17,278 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37611,1695427312292; forceNewPlan=false, retain=false 2023-09-23 00:02:17,278 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:02:17,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 00:02:17,428 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:02:17,431 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7f5e5a1bc6c4d39bcf611c66a32e0ed1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b8a4ae9bf14814b297193bd62a5d93f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,431 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427337431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427337431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427337431"}]},"ts":"1695427337431"} 2023-09-23 00:02:17,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427337431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427337431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427337431"}]},"ts":"1695427337431"} 2023-09-23 00:02:17,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 7f5e5a1bc6c4d39bcf611c66a32e0ed1, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:02:17,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure b8a4ae9bf14814b297193bd62a5d93f6, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:02:17,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 00:02:17,588 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,588 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 00:02:17,593 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 00:02:17,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b8a4ae9bf14814b297193bd62a5d93f6, NAME => 'testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 00:02:17,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. service=AccessControlService 2023-09-23 00:02:17,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:02:17,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:17,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,600 INFO [StoreOpener-b8a4ae9bf14814b297193bd62a5d93f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f5e5a1bc6c4d39bcf611c66a32e0ed1, NAME => 'testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 00:02:17,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. service=AccessControlService 2023-09-23 00:02:17,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:02:17,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:17,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,602 DEBUG [StoreOpener-b8a4ae9bf14814b297193bd62a5d93f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf 2023-09-23 00:02:17,602 DEBUG [StoreOpener-b8a4ae9bf14814b297193bd62a5d93f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf 2023-09-23 00:02:17,602 INFO [StoreOpener-b8a4ae9bf14814b297193bd62a5d93f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8a4ae9bf14814b297193bd62a5d93f6 columnFamilyName cf 2023-09-23 00:02:17,603 INFO [StoreOpener-7f5e5a1bc6c4d39bcf611c66a32e0ed1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,604 INFO [StoreOpener-b8a4ae9bf14814b297193bd62a5d93f6-1] regionserver.HStore(310): Store=b8a4ae9bf14814b297193bd62a5d93f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:02:17,605 DEBUG [StoreOpener-7f5e5a1bc6c4d39bcf611c66a32e0ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf 2023-09-23 00:02:17,605 DEBUG [StoreOpener-7f5e5a1bc6c4d39bcf611c66a32e0ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf 2023-09-23 00:02:17,606 INFO [StoreOpener-7f5e5a1bc6c4d39bcf611c66a32e0ed1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f5e5a1bc6c4d39bcf611c66a32e0ed1 columnFamilyName cf 2023-09-23 00:02:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,607 INFO [StoreOpener-7f5e5a1bc6c4d39bcf611c66a32e0ed1-1] regionserver.HStore(310): Store=7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:02:17,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:17,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:02:17,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:02:17,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b8a4ae9bf14814b297193bd62a5d93f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67285795, jitterRate=0.0026364773511886597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:02:17,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b8a4ae9bf14814b297193bd62a5d93f6: 2023-09-23 00:02:17,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7f5e5a1bc6c4d39bcf611c66a32e0ed1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69813922, jitterRate=0.04030850529670715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:02:17,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7f5e5a1bc6c4d39bcf611c66a32e0ed1: 2023-09-23 00:02:17,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6., pid=31, masterSystemTime=1695427337588 2023-09-23 00:02:17,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1., pid=30, masterSystemTime=1695427337588 2023-09-23 00:02:17,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,623 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b8a4ae9bf14814b297193bd62a5d93f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427337623"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427337623"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427337623"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427337623"}]},"ts":"1695427337623"} 2023-09-23 00:02:17,625 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7f5e5a1bc6c4d39bcf611c66a32e0ed1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,625 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427337625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427337625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427337625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427337625"}]},"ts":"1695427337625"} 2023-09-23 00:02:17,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-23 00:02:17,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure b8a4ae9bf14814b297193bd62a5d93f6, server=jenkins-hbase4.apache.org,42773,1695427312328 in 191 msec 2023-09-23 00:02:17,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-23 00:02:17,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 7f5e5a1bc6c4d39bcf611c66a32e0ed1, server=jenkins-hbase4.apache.org,37611,1695427312292 in 193 msec 2023-09-23 00:02:17,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, ASSIGN in 355 msec 2023-09-23 00:02:17,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-23 00:02:17,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, ASSIGN in 359 msec 2023-09-23 00:02:17,636 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:02:17,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427337636"}]},"ts":"1695427337636"} 2023-09-23 00:02:17,638 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 00:02:17,641 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:02:17,641 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-23 00:02:17,643 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 00:02:17,645 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,645 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,645 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,645 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:17,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:17,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:17,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:17,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:17,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 446 msec 2023-09-23 00:02:17,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 00:02:17,811 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-23 00:02:17,814 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 00:02:17,815 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,817 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:02:17,826 DEBUG [hconnection-0x1eb93e1b-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:17,831 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:17,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:02:17,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427337838 (current time:1695427337838). 2023-09-23 00:02:17,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:02:17,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x349b520c to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:17,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ff3de1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:17,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:17,848 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:17,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x349b520c to 127.0.0.1:52502 2023-09-23 00:02:17,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:17,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x5d746827 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33115ab7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:17,861 DEBUG [hconnection-0x4f7d7901-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:17,864 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:17,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d746827 to 127.0.0.1:52502 2023-09-23 00:02:17,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:17,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 00:02:17,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:02:17,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:02:17,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:02:17,874 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:02:17,875 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695427937875 2023-09-23 00:02:17,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 00:02:17,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:02:17,878 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:02:17,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 00:02:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:02:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:02:17,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-23 00:02:17,880 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 00:02:17,881 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695427937881 2023-09-23 00:02:17,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,898 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-23 00:02:17,898 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:17,900 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 00:02:17,900 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 00:02:17,900 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,900 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,902 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:17,902 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:17,902 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:17,902 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:17,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:17,902 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,902 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,903 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 00:02:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 00:02:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 00:02:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 00:02:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 00:02:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 00:02:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 00:02:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 00:02:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 00:02:17,908 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 00:02:17,908 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 00:02:17,908 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 00:02:17,910 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,910 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:17,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,918 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:17,919 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,919 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:17,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:17,919 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,919 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:17,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38480d8c[Count = 1] remaining members to acquire global barrier 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 00:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38480d8c[Count = 0] remaining members to acquire global barrier 2023-09-23 00:02:17,923 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 00:02:17,923 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:17,924 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,925 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:17,925 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:17,925 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. started... 2023-09-23 00:02:17,926 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f5e5a1bc6c4d39bcf611c66a32e0ed1: 2023-09-23 00:02:17,925 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. started... 2023-09-23 00:02:17,926 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,926 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:02:17,926 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b8a4ae9bf14814b297193bd62a5d93f6: 2023-09-23 00:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 00:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:17,927 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:02:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 00:02:17,947 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. completed. 2023-09-23 00:02:17,947 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:17,947 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:17,947 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:17,947 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,948 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 00:02:17,948 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:02:17,949 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. completed. 2023-09-23 00:02:17,949 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:17,949 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:17,949 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:17,949 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,949 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 00:02:17,949 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:02:17,950 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 00:02:17,950 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,950 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:17,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:17,950 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 00:02:17,955 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 00:02:17,956 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:17,956 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 00:02:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:02:17,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 00:02:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:02:17,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 00:02:17,965 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-23 00:02:17,965 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:02:17,965 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:02:17,965 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,965 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:02:17,967 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:17,967 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:17,967 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:17,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,968 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:17,968 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:17,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:17,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,969 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:17,969 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,972 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,972 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,972 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,975 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:17,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:17,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:17,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:17,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:17,976 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:17,976 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:17,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 00:02:17,978 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,978 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:02:17,979 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:17,979 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:17,979 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,979 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:17,979 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:17,979 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,979 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 00:02:17,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:02:17,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:17,980 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:02:17,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:17,996 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-23 00:02:18,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:18,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 00:02:18,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:18,015 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:18,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695427337875Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695427337990 (+115 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695427337991 (+1 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695427337991Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695427337995 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695427338005 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695427338014 (+9 ms) 2023-09-23 00:02:18,018 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 00:02:18,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 142 msec 2023-09-23 00:02:18,180 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:18,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:02:18,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:02:18,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37611] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:02:18,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:02:18,194 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 00:02:18,194 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:18,194 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:02:18,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:02:18,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427338207 (current time:1695427338207). 2023-09-23 00:02:18,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:02:18,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x214df83c to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:18,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30b60699, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:18,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:18,221 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:18,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x214df83c to 127.0.0.1:52502 2023-09-23 00:02:18,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:18,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x6095da6e to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:18,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ed50bc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:18,230 DEBUG [hconnection-0x7de439de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:18,231 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:18,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6095da6e to 127.0.0.1:52502 2023-09-23 00:02:18,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:18,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 00:02:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:02:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:02:18,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:02:18,243 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:02:18,244 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695427938244 2023-09-23 00:02:18,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:02:18,244 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 00:02:18,246 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:02:18,246 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:02:18,247 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:02:18,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 00:02:18,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-23 00:02:18,250 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 00:02:18,251 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695427938251 2023-09-23 00:02:18,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-23 00:02:18,275 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-23 00:02:18,275 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:18,277 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 00:02:18,277 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 00:02:18,341 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,342 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,343 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:18,343 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:18,343 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:18,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:18,343 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:18,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:18,344 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,344 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,344 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,344 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:02:18,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 00:02:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 00:02:18,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 00:02:18,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 00:02:18,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 00:02:18,346 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 00:02:18,346 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:18,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 00:02:18,348 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:18,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 00:02:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 00:02:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 00:02:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 00:02:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 00:02:18,349 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 00:02:18,349 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 00:02:18,350 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 00:02:18,348 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 00:02:18,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 00:02:18,350 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 00:02:18,350 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:18,351 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 00:02:18,351 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 00:02:18,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:02:18,351 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 00:02:18,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:18,352 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:02:18,355 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,355 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:18,356 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:18,356 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,356 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:18,358 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:18,358 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,358 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:18,358 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,358 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,358 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7115ec[Count = 1] remaining members to acquire global barrier 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:18,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:18,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 00:02:18,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7115ec[Count = 0] remaining members to acquire global barrier 2023-09-23 00:02:18,362 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 00:02:18,363 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:02:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,364 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:02:18,364 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:02:18,364 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:18,365 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:18,364 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 00:02:18,365 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. started... 2023-09-23 00:02:18,365 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,365 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:02:18,365 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:18,365 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7f5e5a1bc6c4d39bcf611c66a32e0ed1 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-23 00:02:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:02:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:18,365 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. started... 2023-09-23 00:02:18,366 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b8a4ae9bf14814b297193bd62a5d93f6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-23 00:02:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 00:02:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 00:02:18,407 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092396487a4b50384679aba9db758ed49528 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092396487a4b50384679aba9db758ed49528 2023-09-23 00:02:18,407 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923cbde6c4d620b43b5877beaf712f96bdc to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbde6c4d620b43b5877beaf712f96bdc 2023-09-23 00:02:18,425 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/.tmp/cf/a6b861fe845d40f7bb63dd59b8682d4c 2023-09-23 00:02:18,429 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/.tmp/cf/35baa858a508459eb5e57ccb872d7e4c 2023-09-23 00:02:18,434 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/.tmp/cf/a6b861fe845d40f7bb63dd59b8682d4c as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf/a6b861fe845d40f7bb63dd59b8682d4c 2023-09-23 00:02:18,437 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/.tmp/cf/35baa858a508459eb5e57ccb872d7e4c as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf/35baa858a508459eb5e57ccb872d7e4c 2023-09-23 00:02:18,444 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf/a6b861fe845d40f7bb63dd59b8682d4c, entries=47, sequenceid=6, filesize=12.8 K 2023-09-23 00:02:18,444 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf/35baa858a508459eb5e57ccb872d7e4c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-23 00:02:18,449 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7f5e5a1bc6c4d39bcf611c66a32e0ed1 in 84ms, sequenceid=6, compaction requested=false 2023-09-23 00:02:18,449 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b8a4ae9bf14814b297193bd62a5d93f6 in 84ms, sequenceid=6, compaction requested=false 2023-09-23 00:02:18,450 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f5e5a1bc6c4d39bcf611c66a32e0ed1: 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b8a4ae9bf14814b297193bd62a5d93f6: 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf/35baa858a508459eb5e57ccb872d7e4c] hfiles 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf/35baa858a508459eb5e57ccb872d7e4c for snapshot=snaptb0-testExportFileSystemState 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf/a6b861fe845d40f7bb63dd59b8682d4c] hfiles 2023-09-23 00:02:18,451 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf/a6b861fe845d40f7bb63dd59b8682d4c for snapshot=snaptb0-testExportFileSystemState 2023-09-23 00:02:18,469 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. completed. 2023-09-23 00:02:18,469 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:18,470 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:18,470 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,474 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 00:02:18,474 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:02:18,478 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 00:02:18,478 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,479 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:18,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:18,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:18,479 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. completed. 2023-09-23 00:02:18,479 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 00:02:18,480 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:18,481 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:18,481 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:18,481 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,481 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 00:02:18,481 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:02:18,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:18,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:18,482 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 00:02:18,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,482 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:18,482 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,482 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 00:02:18,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:18,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:18,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:18,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:02:18,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 00:02:18,490 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-23 00:02:18,491 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:02:18,491 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:02:18,491 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-23 00:02:18,491 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:02:18,493 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,493 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:18,494 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:18,494 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,494 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:18,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:18,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:18,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:18,495 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:18,495 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,496 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:18,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,498 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,498 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:18,498 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 00:02:18,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:18,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:18,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:18,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:18,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:18,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:18,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:18,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-23 00:02:18,503 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,503 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:18,503 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,503 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:18,503 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:18,503 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,503 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,502 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:18,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:18,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:18,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 00:02:18,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:18,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:18,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 00:02:18,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:02:18,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbde6c4d620b43b5877beaf712f96bdc, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092396487a4b50384679aba9db758ed49528] mob files 2023-09-23 00:02:18,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbde6c4d620b43b5877beaf712f96bdc 2023-09-23 00:02:18,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092396487a4b50384679aba9db758ed49528 2023-09-23 00:02:18,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-23 00:02:18,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 00:02:18,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,547 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695427338245Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695427338520 (+275 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695427338520Loading Region manifests for snaptb0-testExportFileSystemState at 1695427338520Writing data manifest for snaptb0-testExportFileSystemState at 1695427338525 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695427338537 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695427338547 (+10 ms) 2023-09-23 00:02:18,550 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 00:02:18,552 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:18,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 304 msec 2023-09-23 00:02:18,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:02:18,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:02:18,554 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554 2023-09-23 00:02:18,554 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33037, tgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554, rawTgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:18,577 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:18,577 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1632296299_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,578 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-23 00:02:18,591 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 00:02:18,619 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:18,619 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:18,620 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:18,620 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,555 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-6230043320999344522.jar 2023-09-23 00:02:19,556 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,556 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,624 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-3221014021032218851.jar 2023-09-23 00:02:19,624 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,625 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,625 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,625 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,626 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,626 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:19,626 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:02:19,627 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:02:19,627 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:02:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:02:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:02:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:02:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:02:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:02:19,630 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:02:19,630 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:02:19,631 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:19,631 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:19,632 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:19,632 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:19,632 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:19,633 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:19,633 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:20,101 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:02:20,104 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-23 00:02:20,106 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 00:02:21,324 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:21,324 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:21,330 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0001_000001 (auth:SIMPLE) 2023-09-23 00:02:21,791 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0002_000001 (auth:SIMPLE) 2023-09-23 00:02:22,242 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:02:25,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0002_000001 (auth:SIMPLE) 2023-09-23 00:02:28,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0002_000001 (auth:SIMPLE) 2023-09-23 00:02:31,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0002_000001 (auth:SIMPLE) 2023-09-23 00:02:33,319 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:02:33,320 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:02:33,329 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-23 00:02:33,329 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:02:33,329 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:02:33,329 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 00:02:33,330 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 00:02:33,330 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 00:02:33,330 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 00:02:33,331 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 00:02:33,331 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427338554/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 00:02:33,337 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-23 00:02:33,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-23 00:02:33,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 00:02:33,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427353343"}]},"ts":"1695427353343"} 2023-09-23 00:02:33,344 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 00:02:33,346 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-23 00:02:33,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, UNASSIGN}] 2023-09-23 00:02:33,349 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, UNASSIGN 2023-09-23 00:02:33,349 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, UNASSIGN 2023-09-23 00:02:33,350 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b8a4ae9bf14814b297193bd62a5d93f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:33,350 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427353350"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427353350"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427353350"}]},"ts":"1695427353350"} 2023-09-23 00:02:33,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7f5e5a1bc6c4d39bcf611c66a32e0ed1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:33,351 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427353350"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427353350"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427353350"}]},"ts":"1695427353350"} 2023-09-23 00:02:33,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure b8a4ae9bf14814b297193bd62a5d93f6, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:02:33,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 7f5e5a1bc6c4d39bcf611c66a32e0ed1, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:02:33,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 00:02:33,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:33,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b8a4ae9bf14814b297193bd62a5d93f6, disabling compactions & flushes 2023-09-23 00:02:33,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:33,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:33,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. after waiting 0 ms 2023-09-23 00:02:33,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:33,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:33,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7f5e5a1bc6c4d39bcf611c66a32e0ed1, disabling compactions & flushes 2023-09-23 00:02:33,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:33,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:33,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. after waiting 0 ms 2023-09-23 00:02:33,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:33,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:02:33,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:02:33,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:33,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6. 2023-09-23 00:02:33,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b8a4ae9bf14814b297193bd62a5d93f6: 2023-09-23 00:02:33,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:02:33,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1. 2023-09-23 00:02:33,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7f5e5a1bc6c4d39bcf611c66a32e0ed1: 2023-09-23 00:02:33,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:33,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b8a4ae9bf14814b297193bd62a5d93f6, regionState=CLOSED 2023-09-23 00:02:33,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:33,519 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427353519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427353519"}]},"ts":"1695427353519"} 2023-09-23 00:02:33,520 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7f5e5a1bc6c4d39bcf611c66a32e0ed1, regionState=CLOSED 2023-09-23 00:02:33,520 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695427353520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427353520"}]},"ts":"1695427353520"} 2023-09-23 00:02:33,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-23 00:02:33,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure b8a4ae9bf14814b297193bd62a5d93f6, server=jenkins-hbase4.apache.org,42773,1695427312328 in 169 msec 2023-09-23 00:02:33,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-23 00:02:33,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 7f5e5a1bc6c4d39bcf611c66a32e0ed1, server=jenkins-hbase4.apache.org,37611,1695427312292 in 169 msec 2023-09-23 00:02:33,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b8a4ae9bf14814b297193bd62a5d93f6, UNASSIGN in 176 msec 2023-09-23 00:02:33,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-23 00:02:33,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7f5e5a1bc6c4d39bcf611c66a32e0ed1, UNASSIGN in 177 msec 2023-09-23 00:02:33,527 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427353527"}]},"ts":"1695427353527"} 2023-09-23 00:02:33,528 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 00:02:33,530 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-23 00:02:33,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-09-23 00:02:33,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 00:02:33,645 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-23 00:02:33,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-23 00:02:33,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,649 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-23 00:02:33,650 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,651 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-23 00:02:33,655 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:33,655 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:33,655 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,655 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,655 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,655 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 00:02:33,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 00:02:33,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 00:02:33,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:33,657 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:33,657 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/recovered.edits] 2023-09-23 00:02:33,658 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/recovered.edits] 2023-09-23 00:02:33,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 00:02:33,662 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf/35baa858a508459eb5e57ccb872d7e4c to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/cf/35baa858a508459eb5e57ccb872d7e4c 2023-09-23 00:02:33,662 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf/a6b861fe845d40f7bb63dd59b8682d4c to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/cf/a6b861fe845d40f7bb63dd59b8682d4c 2023-09-23 00:02:33,666 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1/recovered.edits/9.seqid 2023-09-23 00:02:33,666 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6/recovered.edits/9.seqid 2023-09-23 00:02:33,666 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/7f5e5a1bc6c4d39bcf611c66a32e0ed1 2023-09-23 00:02:33,666 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemState/b8a4ae9bf14814b297193bd62a5d93f6 2023-09-23 00:02:33,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 00:02:33,667 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 00:02:33,668 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-23 00:02:33,671 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbde6c4d620b43b5877beaf712f96bdc to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbde6c4d620b43b5877beaf712f96bdc 2023-09-23 00:02:33,673 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092396487a4b50384679aba9db758ed49528 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092396487a4b50384679aba9db758ed49528 2023-09-23 00:02:33,673 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 00:02:33,676 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,678 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-23 00:02:33,681 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-23 00:02:33,683 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,683 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-23 00:02:33,683 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427353683"}]},"ts":"9223372036854775807"} 2023-09-23 00:02:33,683 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427353683"}]},"ts":"9223372036854775807"} 2023-09-23 00:02:33,685 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 00:02:33,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7f5e5a1bc6c4d39bcf611c66a32e0ed1, NAME => 'testtb-testExportFileSystemState,,1695427337199.7f5e5a1bc6c4d39bcf611c66a32e0ed1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b8a4ae9bf14814b297193bd62a5d93f6, NAME => 'testtb-testExportFileSystemState,1,1695427337199.b8a4ae9bf14814b297193bd62a5d93f6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 00:02:33,686 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-23 00:02:33,686 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427353686"}]},"ts":"9223372036854775807"} 2023-09-23 00:02:33,687 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-23 00:02:33,689 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 00:02:33,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-09-23 00:02:33,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 00:02:33,760 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-23 00:02:33,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-23 00:02:33,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-23 00:02:33,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-23 00:02:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-23 00:02:33,809 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 753) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1369621705_1 at /127.0.0.1:50016 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:59446 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:34874 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:40755 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1369621705_1 at /127.0.0.1:59416 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:50026 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 120) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=1587 (was 1652) 2023-09-23 00:02:33,809 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 00:02:33,829 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=171, AvailableMemoryMB=1586 2023-09-23 00:02:33,829 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 00:02:33,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 00:02:33,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:02:33,835 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:02:33,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-23 00:02:33,836 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:02:33,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 00:02:33,838 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:33,838 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:33,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 empty. 2023-09-23 00:02:33,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 empty. 2023-09-23 00:02:33,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:33,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:33,839 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 00:02:33,854 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-23 00:02:33,856 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => f2878aabe594750ead0426a90a67c996, NAME => 'testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:02:33,856 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1c5395e52f9f4c8f03e2691008ef62f3, NAME => 'testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing f2878aabe594750ead0426a90a67c996, disabling compactions & flushes 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 1c5395e52f9f4c8f03e2691008ef62f3, disabling compactions & flushes 2023-09-23 00:02:33,868 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:33,868 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. after waiting 0 ms 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. after waiting 0 ms 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:33,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:33,868 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:33,869 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:33,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for f2878aabe594750ead0426a90a67c996: 2023-09-23 00:02:33,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 1c5395e52f9f4c8f03e2691008ef62f3: 2023-09-23 00:02:33,871 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:02:33,872 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427353872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427353872"}]},"ts":"1695427353872"} 2023-09-23 00:02:33,872 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427353872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427353872"}]},"ts":"1695427353872"} 2023-09-23 00:02:33,875 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:02:33,876 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:02:33,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427353876"}]},"ts":"1695427353876"} 2023-09-23 00:02:33,877 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-23 00:02:33,882 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:02:33,883 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:02:33,883 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:02:33,883 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:02:33,883 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:02:33,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, ASSIGN}] 2023-09-23 00:02:33,889 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, ASSIGN 2023-09-23 00:02:33,889 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, ASSIGN 2023-09-23 00:02:33,890 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:02:33,890 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44515,1695427312235; forceNewPlan=false, retain=false 2023-09-23 00:02:33,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 00:02:34,040 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:02:34,043 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1c5395e52f9f4c8f03e2691008ef62f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f2878aabe594750ead0426a90a67c996, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,043 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427354043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427354043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427354043"}]},"ts":"1695427354043"} 2023-09-23 00:02:34,043 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427354043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427354043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427354043"}]},"ts":"1695427354043"} 2023-09-23 00:02:34,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 1c5395e52f9f4c8f03e2691008ef62f3, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:02:34,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure f2878aabe594750ead0426a90a67c996, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:02:34,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 00:02:34,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2878aabe594750ead0426a90a67c996, NAME => 'testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 00:02:34,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c5395e52f9f4c8f03e2691008ef62f3, NAME => 'testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 00:02:34,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. service=AccessControlService 2023-09-23 00:02:34,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. service=AccessControlService 2023-09-23 00:02:34,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,205 INFO [StoreOpener-f2878aabe594750ead0426a90a67c996-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,205 INFO [StoreOpener-1c5395e52f9f4c8f03e2691008ef62f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,207 DEBUG [StoreOpener-f2878aabe594750ead0426a90a67c996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf 2023-09-23 00:02:34,207 DEBUG [StoreOpener-1c5395e52f9f4c8f03e2691008ef62f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf 2023-09-23 00:02:34,207 DEBUG [StoreOpener-1c5395e52f9f4c8f03e2691008ef62f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf 2023-09-23 00:02:34,207 DEBUG [StoreOpener-f2878aabe594750ead0426a90a67c996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf 2023-09-23 00:02:34,207 INFO [StoreOpener-f2878aabe594750ead0426a90a67c996-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2878aabe594750ead0426a90a67c996 columnFamilyName cf 2023-09-23 00:02:34,207 INFO [StoreOpener-1c5395e52f9f4c8f03e2691008ef62f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c5395e52f9f4c8f03e2691008ef62f3 columnFamilyName cf 2023-09-23 00:02:34,209 INFO [StoreOpener-1c5395e52f9f4c8f03e2691008ef62f3-1] regionserver.HStore(310): Store=1c5395e52f9f4c8f03e2691008ef62f3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:02:34,209 INFO [StoreOpener-f2878aabe594750ead0426a90a67c996-1] regionserver.HStore(310): Store=f2878aabe594750ead0426a90a67c996/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2878aabe594750ead0426a90a67c996 2023-09-23 00:02:34,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:02:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:02:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:02:34,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2878aabe594750ead0426a90a67c996; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63499678, jitterRate=-0.05378106236457825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:02:34,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2878aabe594750ead0426a90a67c996: 2023-09-23 00:02:34,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c5395e52f9f4c8f03e2691008ef62f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59651524, jitterRate=-0.11112302541732788}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:02:34,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c5395e52f9f4c8f03e2691008ef62f3: 2023-09-23 00:02:34,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996., pid=46, masterSystemTime=1695427354197 2023-09-23 00:02:34,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3., pid=45, masterSystemTime=1695427354197 2023-09-23 00:02:34,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,220 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f2878aabe594750ead0426a90a67c996, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,220 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427354220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427354220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427354220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427354220"}]},"ts":"1695427354220"} 2023-09-23 00:02:34,221 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1c5395e52f9f4c8f03e2691008ef62f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,221 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427354221"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427354221"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427354221"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427354221"}]},"ts":"1695427354221"} 2023-09-23 00:02:34,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-23 00:02:34,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure f2878aabe594750ead0426a90a67c996, server=jenkins-hbase4.apache.org,42773,1695427312328 in 176 msec 2023-09-23 00:02:34,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-23 00:02:34,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 1c5395e52f9f4c8f03e2691008ef62f3, server=jenkins-hbase4.apache.org,44515,1695427312235 in 179 msec 2023-09-23 00:02:34,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, ASSIGN in 342 msec 2023-09-23 00:02:34,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-23 00:02:34,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, ASSIGN in 343 msec 2023-09-23 00:02:34,229 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:02:34,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427354229"}]},"ts":"1695427354229"} 2023-09-23 00:02:34,231 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-23 00:02:34,234 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:02:34,234 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-23 00:02:34,236 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 00:02:34,237 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:34,237 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:34,237 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:34,237 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:02:34,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:34,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:34,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:34,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 00:02:34,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 408 msec 2023-09-23 00:02:34,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 00:02:34,439 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-23 00:02:34,442 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 00:02:34,442 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,444 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:02:34,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 00:02:34,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427354456 (current time:1695427354456). 2023-09-23 00:02:34,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:02:34,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x451e96b3 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:34,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1778f68b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:34,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:34,471 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:34,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x451e96b3 to 127.0.0.1:52502 2023-09-23 00:02:34,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:34,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x4829ca57 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:34,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@793376ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:34,484 DEBUG [hconnection-0x29af1bec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:34,487 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:34,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4829ca57 to 127.0.0.1:52502 2023-09-23 00:02:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 00:02:34,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:02:34,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 00:02:34,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 00:02:34,497 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 00:02:34,498 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695427954498 2023-09-23 00:02:34,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 00:02:34,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 00:02:34,499 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:02:34,500 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:02:34,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 00:02:34,501 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 00:02:34,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-23 00:02:34,503 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 00:02:34,503 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695427954503 2023-09-23 00:02:34,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,515 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-23 00:02:34,515 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,517 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 00:02:34,517 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 00:02:34,517 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,517 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,519 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,519 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,519 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,519 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,520 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,520 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,520 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,520 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 00:02:34,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,522 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 00:02:34,522 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 00:02:34,522 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,522 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 00:02:34,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 00:02:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 00:02:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 00:02:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 00:02:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,530 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,531 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,532 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,532 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4188ff95[Count = 1] remaining members to acquire global barrier 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 00:02:34,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4188ff95[Count = 0] remaining members to acquire global barrier 2023-09-23 00:02:34,536 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 00:02:34,536 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,537 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 00:02:34,537 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 00:02:34,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:02:34,538 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,538 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 00:02:34,538 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. started... 2023-09-23 00:02:34,538 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:34,538 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,538 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2878aabe594750ead0426a90a67c996: 2023-09-23 00:02:34,538 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. started... 2023-09-23 00:02:34,538 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,540 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:34,540 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:02:34,540 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c5395e52f9f4c8f03e2691008ef62f3: 2023-09-23 00:02:34,540 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,541 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:34,541 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:02:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 00:02:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 00:02:34,553 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. completed. 2023-09-23 00:02:34,553 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,554 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:34,554 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:34,554 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,554 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 00:02:34,554 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:02:34,555 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. completed. 2023-09-23 00:02:34,555 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 00:02:34,556 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 00:02:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 00:02:34,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:02:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,559 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 00:02:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,559 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,559 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 00:02:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44515,1695427312235': 2023-09-23 00:02:34,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 00:02:34,566 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-23 00:02:34,566 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:02:34,566 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:02:34,566 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,566 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,568 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,569 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,570 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,572 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,572 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,573 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,579 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,579 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,579 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,580 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,580 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,582 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,582 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 00:02:34,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,582 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,584 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,584 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:02:34,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 00:02:34,600 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 00:02:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:34,602 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:02:34,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 00:02:34,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,628 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 00:02:34,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695427354498Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695427354603 (+105 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695427354603Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695427354603Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695427354607 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695427354620 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695427354628 (+8 ms) 2023-09-23 00:02:34,631 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 00:02:34,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 132 msec 2023-09-23 00:02:34,802 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 00:02:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:02:34,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:02:34,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44515] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:02:34,811 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 00:02:34,811 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,811 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:02:34,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 00:02:34,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427354821 (current time:1695427354821). 2023-09-23 00:02:34,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:02:34,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x1e589385 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:34,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e7068be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:34,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:34,836 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:34,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e589385 to 127.0.0.1:52502 2023-09-23 00:02:34,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:34,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x67d5411a to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:02:34,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d4b22de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:02:34,846 DEBUG [hconnection-0x439851-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:02:34,848 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:02:34,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67d5411a to 127.0.0.1:52502 2023-09-23 00:02:34,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:02:34,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 00:02:34,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:02:34,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 00:02:34,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 00:02:34,857 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 00:02:34,858 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695427954858 2023-09-23 00:02:34,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 00:02:34,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 00:02:34,859 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:02:34,859 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:02:34,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 00:02:34,860 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 00:02:34,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-23 00:02:34,862 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 00:02:34,862 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695427954862 2023-09-23 00:02:34,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-23 00:02:34,872 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-23 00:02:34,872 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,874 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 00:02:34,874 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 00:02:34,874 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,874 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,876 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,876 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,876 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,876 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,876 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,876 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,877 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,877 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 00:02:34,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 00:02:34,878 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 00:02:34,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 00:02:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,878 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 00:02:34,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 00:02:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 00:02:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 00:02:34,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 00:02:34,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 00:02:34,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 00:02:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 00:02:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,881 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 00:02:34,881 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 00:02:34,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 00:02:34,881 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 00:02:34,881 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 00:02:34,881 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:02:34,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 00:02:34,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 00:02:34,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 00:02:34,882 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,882 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,884 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:34,885 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,885 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,886 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:34,885 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,886 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,886 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:02:34,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7281d82d[Count = 1] remaining members to acquire global barrier 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 00:02:34,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7281d82d[Count = 0] remaining members to acquire global barrier 2023-09-23 00:02:34,890 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 00:02:34,890 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,892 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:34,892 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:02:34,892 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 00:02:34,892 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. started... 2023-09-23 00:02:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:02:34,892 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:02:34,892 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,893 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:02:34,893 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. started... 2023-09-23 00:02:34,893 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1c5395e52f9f4c8f03e2691008ef62f3 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-23 00:02:34,893 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f2878aabe594750ead0426a90a67c996 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-23 00:02:34,895 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 00:02:34,895 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,895 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 00:02:34,919 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923e664fb4cbf244282b051801160c9b5d8 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923e664fb4cbf244282b051801160c9b5d8 2023-09-23 00:02:34,919 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092361c19107fc7d48fab0230a1bbe8143b0 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092361c19107fc7d48fab0230a1bbe8143b0 2023-09-23 00:02:34,937 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/.tmp/cf/345cf729f4dc4fd7a40915c7823cab2a 2023-09-23 00:02:34,944 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/.tmp/cf/acaa977b5c6e42559591a8bf50b3072a 2023-09-23 00:02:34,949 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/.tmp/cf/345cf729f4dc4fd7a40915c7823cab2a as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf/345cf729f4dc4fd7a40915c7823cab2a 2023-09-23 00:02:34,950 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/.tmp/cf/acaa977b5c6e42559591a8bf50b3072a as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf/acaa977b5c6e42559591a8bf50b3072a 2023-09-23 00:02:34,954 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf/345cf729f4dc4fd7a40915c7823cab2a, entries=5, sequenceid=6, filesize=5.7 K 2023-09-23 00:02:34,955 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for f2878aabe594750ead0426a90a67c996 in 62ms, sequenceid=6, compaction requested=false 2023-09-23 00:02:34,955 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-23 00:02:34,955 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf/acaa977b5c6e42559591a8bf50b3072a, entries=45, sequenceid=6, filesize=12.4 K 2023-09-23 00:02:34,955 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2878aabe594750ead0426a90a67c996: 2023-09-23 00:02:34,956 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 00:02:34,956 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:34,956 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf/345cf729f4dc4fd7a40915c7823cab2a] hfiles 2023-09-23 00:02:34,956 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf/345cf729f4dc4fd7a40915c7823cab2a for snapshot=snaptb0-testConsecutiveExports 2023-09-23 00:02:34,956 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 1c5395e52f9f4c8f03e2691008ef62f3 in 63ms, sequenceid=6, compaction requested=false 2023-09-23 00:02:34,958 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c5395e52f9f4c8f03e2691008ef62f3: 2023-09-23 00:02:34,958 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 00:02:34,958 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:02:34,958 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf/acaa977b5c6e42559591a8bf50b3072a] hfiles 2023-09-23 00:02:34,958 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf/acaa977b5c6e42559591a8bf50b3072a for snapshot=snaptb0-testConsecutiveExports 2023-09-23 00:02:34,959 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:34,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 00:02:34,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:02:34,961 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:02:34,972 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. completed. 2023-09-23 00:02:34,972 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:02:34,972 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:34,972 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:34,972 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,972 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 00:02:34,972 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:02:34,974 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. completed. 2023-09-23 00:02:34,974 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:02:34,974 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:02:34,974 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:02:34,974 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,974 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 00:02:34,974 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:02:34,975 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 00:02:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 00:02:34,977 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 00:02:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 00:02:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44515,1695427312235': 2023-09-23 00:02:34,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 00:02:34,984 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-23 00:02:34,984 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:02:34,984 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:02:34,984 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-23 00:02:34,984 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:02:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:02:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,987 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,986 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,987 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,987 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:02:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 00:02:34,989 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:34,990 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:34,990 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:02:34,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-23 00:02:34,998 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:02:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:34,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:02:34,997 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:02:35,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:34,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 00:02:34,998 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:35,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:35,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:35,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 00:02:35,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:02:35,000 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:02:35,000 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,001 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:02:35,001 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,001 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:02:35,001 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:02:35,001 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,001 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092361c19107fc7d48fab0230a1bbe8143b0, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923e664fb4cbf244282b051801160c9b5d8] mob files 2023-09-23 00:02:35,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092361c19107fc7d48fab0230a1bbe8143b0 2023-09-23 00:02:35,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923e664fb4cbf244282b051801160c9b5d8 2023-09-23 00:02:35,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-23 00:02:35,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 00:02:35,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,034 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695427354858Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695427355011 (+153 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695427355011Loading Region manifests for snaptb0-testConsecutiveExports at 1695427355011Writing data manifest for snaptb0-testConsecutiveExports at 1695427355015 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695427355026 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695427355034 (+8 ms) 2023-09-23 00:02:35,037 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 00:02:35,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 179 msec 2023-09-23 00:02:35,161 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:02:35,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 00:02:35,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:02:35,163 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162 2023-09-23 00:02:35,163 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@79dd2088, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,186 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 00:02:35,194 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:35,207 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:35,208 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:35,208 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:35,208 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,085 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-5451725069749128447.jar 2023-09-23 00:02:36,086 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,086 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,152 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-2829218415914085792.jar 2023-09-23 00:02:36,153 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,153 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,154 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,154 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,154 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,155 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:36,155 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:02:36,155 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:02:36,156 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:02:36,156 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:02:36,156 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:02:36,157 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:02:36,157 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:02:36,158 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:02:36,158 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:02:36,158 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:02:36,159 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:36,159 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:36,160 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:36,160 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:36,160 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:36,161 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:36,161 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:36,543 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:02:36,546 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 00:02:36,547 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 00:02:37,466 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:37,466 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:37,469 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0002_000001 (auth:SIMPLE) 2023-09-23 00:02:38,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0003_000001 (auth:SIMPLE) 2023-09-23 00:02:39,101 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:02:41,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0003_000001 (auth:SIMPLE) 2023-09-23 00:02:44,152 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0003_000001 (auth:SIMPLE) 2023-09-23 00:02:46,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0003_000001 (auth:SIMPLE) 2023-09-23 00:02:47,700 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:02:47,700 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:02:47,704 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 00:02:47,705 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:02:47,705 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:02:47,705 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 00:02:47,708 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 00:02:47,708 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 00:02:47,708 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3ace7065 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 00:02:47,709 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 00:02:47,709 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 00:02:47,710 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:47,731 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:02:47,731 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@387b3a74, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:47,732 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 00:02:47,743 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 00:02:47,755 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:47,755 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:47,756 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:47,756 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,625 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-5958497126091164582.jar 2023-09-23 00:02:48,626 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,626 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-852417519678420921.jar 2023-09-23 00:02:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:02:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:02:48,696 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:02:48,696 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:02:48,696 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:02:48,697 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:02:48,697 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:02:48,698 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:02:48,698 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:02:48,698 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:02:48,699 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:02:48,699 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:48,700 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:48,700 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:48,700 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:48,701 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:02:48,701 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:48,702 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:02:49,053 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:02:49,055 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 00:02:49,057 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 00:02:52,629 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:52,629 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:02:52,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0003_000001 (auth:SIMPLE) 2023-09-23 00:02:53,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0004_000001 (auth:SIMPLE) 2023-09-23 00:02:57,198 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0004_000001 (auth:SIMPLE) 2023-09-23 00:02:59,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0004_000001 (auth:SIMPLE) 2023-09-23 00:03:01,680 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0004_000001 (auth:SIMPLE) 2023-09-23 00:03:03,219 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:03:03,219 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:03:03,222 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 00:03:03,222 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:03:03,223 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:03:03,223 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 00:03:03,226 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 00:03:03,226 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 00:03:03,226 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3ace7065 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 00:03:03,227 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 00:03:03,227 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/local-export-1695427355162/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 00:03:03,239 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-23 00:03:03,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-23 00:03:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 00:03:03,244 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427383243"}]},"ts":"1695427383243"} 2023-09-23 00:03:03,245 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-23 00:03:03,247 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-23 00:03:03,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, UNASSIGN}] 2023-09-23 00:03:03,249 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, UNASSIGN 2023-09-23 00:03:03,249 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, UNASSIGN 2023-09-23 00:03:03,250 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1c5395e52f9f4c8f03e2691008ef62f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:03,250 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f2878aabe594750ead0426a90a67c996, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:03,251 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427383250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427383250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427383250"}]},"ts":"1695427383250"} 2023-09-23 00:03:03,251 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427383250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427383250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427383250"}]},"ts":"1695427383250"} 2023-09-23 00:03:03,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 1c5395e52f9f4c8f03e2691008ef62f3, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:03:03,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure f2878aabe594750ead0426a90a67c996, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:03,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 00:03:03,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:03:03,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f2878aabe594750ead0426a90a67c996 2023-09-23 00:03:03,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c5395e52f9f4c8f03e2691008ef62f3, disabling compactions & flushes 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2878aabe594750ead0426a90a67c996, disabling compactions & flushes 2023-09-23 00:03:03,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:03:03,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. after waiting 0 ms 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. after waiting 0 ms 2023-09-23 00:03:03,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:03:03,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:03,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:03,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:03,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3. 2023-09-23 00:03:03,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c5395e52f9f4c8f03e2691008ef62f3: 2023-09-23 00:03:03,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:03,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996. 2023-09-23 00:03:03,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2878aabe594750ead0426a90a67c996: 2023-09-23 00:03:03,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:03:03,423 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1c5395e52f9f4c8f03e2691008ef62f3, regionState=CLOSED 2023-09-23 00:03:03,423 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427383423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427383423"}]},"ts":"1695427383423"} 2023-09-23 00:03:03,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f2878aabe594750ead0426a90a67c996 2023-09-23 00:03:03,424 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f2878aabe594750ead0426a90a67c996, regionState=CLOSED 2023-09-23 00:03:03,424 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695427383424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427383424"}]},"ts":"1695427383424"} 2023-09-23 00:03:03,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-23 00:03:03,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 1c5395e52f9f4c8f03e2691008ef62f3, server=jenkins-hbase4.apache.org,44515,1695427312235 in 173 msec 2023-09-23 00:03:03,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-23 00:03:03,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure f2878aabe594750ead0426a90a67c996, server=jenkins-hbase4.apache.org,42773,1695427312328 in 173 msec 2023-09-23 00:03:03,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1c5395e52f9f4c8f03e2691008ef62f3, UNASSIGN in 179 msec 2023-09-23 00:03:03,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-23 00:03:03,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f2878aabe594750ead0426a90a67c996, UNASSIGN in 180 msec 2023-09-23 00:03:03,429 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427383429"}]},"ts":"1695427383429"} 2023-09-23 00:03:03,430 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-23 00:03:03,432 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-23 00:03:03,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-09-23 00:03:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 00:03:03,545 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-23 00:03:03,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-23 00:03:03,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-23 00:03:03,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,553 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-23 00:03:03,556 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 2023-09-23 00:03:03,556 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:03:03,557 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,558 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,558 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,557 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 00:03:03,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 00:03:03,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 00:03:03,558 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/recovered.edits] 2023-09-23 00:03:03,558 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/recovered.edits] 2023-09-23 00:03:03,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:03,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-23 00:03:03,559 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 00:03:03,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:03,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 00:03:03,559 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:03,561 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:03,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 00:03:03,564 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf/345cf729f4dc4fd7a40915c7823cab2a to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/cf/345cf729f4dc4fd7a40915c7823cab2a 2023-09-23 00:03:03,564 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf/acaa977b5c6e42559591a8bf50b3072a to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/cf/acaa977b5c6e42559591a8bf50b3072a 2023-09-23 00:03:03,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996/recovered.edits/9.seqid 2023-09-23 00:03:03,567 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3/recovered.edits/9.seqid 2023-09-23 00:03:03,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/f2878aabe594750ead0426a90a67c996 2023-09-23 00:03:03,568 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testConsecutiveExports/1c5395e52f9f4c8f03e2691008ef62f3 2023-09-23 00:03:03,568 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 00:03:03,568 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 00:03:03,569 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-23 00:03:03,572 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092361c19107fc7d48fab0230a1bbe8143b0 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092361c19107fc7d48fab0230a1bbe8143b0 2023-09-23 00:03:03,573 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923e664fb4cbf244282b051801160c9b5d8 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923e664fb4cbf244282b051801160c9b5d8 2023-09-23 00:03:03,573 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 00:03:03,575 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,578 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-23 00:03:03,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-23 00:03:03,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-23 00:03:03,581 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427383581"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:03,581 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427383581"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:03,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 00:03:03,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f2878aabe594750ead0426a90a67c996, NAME => 'testtb-testConsecutiveExports,,1695427353830.f2878aabe594750ead0426a90a67c996.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1c5395e52f9f4c8f03e2691008ef62f3, NAME => 'testtb-testConsecutiveExports,1,1695427353830.1c5395e52f9f4c8f03e2691008ef62f3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 00:03:03,583 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-23 00:03:03,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427383583"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:03,584 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-23 00:03:03,586 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 00:03:03,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-09-23 00:03:03,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 00:03:03,663 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-23 00:03:03,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-23 00:03:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-23 00:03:03,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-23 00:03:03,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-23 00:03:03,703 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=751 (was 765), OpenFileDescriptor=901 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 160) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=1319 (was 1586) 2023-09-23 00:03:03,703 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-09-23 00:03:03,722 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=171, AvailableMemoryMB=1319 2023-09-23 00:03:03,722 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-09-23 00:03:03,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 00:03:03,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:03,727 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:03:03,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-23 00:03:03,728 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:03:03,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 00:03:03,731 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:03,731 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:03,731 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 empty. 2023-09-23 00:03:03,731 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 empty. 2023-09-23 00:03:03,732 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:03,732 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:03,732 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 00:03:03,744 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-23 00:03:03,745 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd156b2344280434a7e6c12f695d5da4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:03,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3bd383710a444ba7fb66ef16d2d841d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing dd156b2344280434a7e6c12f695d5da4, disabling compactions & flushes 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 3bd383710a444ba7fb66ef16d2d841d2, disabling compactions & flushes 2023-09-23 00:03:03,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:03,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. after waiting 0 ms 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. after waiting 0 ms 2023-09-23 00:03:03,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:03,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for dd156b2344280434a7e6c12f695d5da4: 2023-09-23 00:03:03,761 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:03,761 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 3bd383710a444ba7fb66ef16d2d841d2: 2023-09-23 00:03:03,763 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:03:03,764 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427383764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427383764"}]},"ts":"1695427383764"} 2023-09-23 00:03:03,764 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427383764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427383764"}]},"ts":"1695427383764"} 2023-09-23 00:03:03,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:03:03,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:03:03,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427383771"}]},"ts":"1695427383771"} 2023-09-23 00:03:03,772 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-23 00:03:03,776 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:03:03,778 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:03:03,778 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:03:03,778 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:03:03,778 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:03:03,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, ASSIGN}] 2023-09-23 00:03:03,780 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, ASSIGN 2023-09-23 00:03:03,780 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, ASSIGN 2023-09-23 00:03:03,781 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:03:03,781 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37611,1695427312292; forceNewPlan=false, retain=false 2023-09-23 00:03:03,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 00:03:03,931 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:03:03,934 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3bd383710a444ba7fb66ef16d2d841d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:03,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dd156b2344280434a7e6c12f695d5da4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:03,934 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427383934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427383934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427383934"}]},"ts":"1695427383934"} 2023-09-23 00:03:03,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427383934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427383934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427383934"}]},"ts":"1695427383934"} 2023-09-23 00:03:03,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 3bd383710a444ba7fb66ef16d2d841d2, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:03,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure dd156b2344280434a7e6c12f695d5da4, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:04,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 00:03:04,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3bd383710a444ba7fb66ef16d2d841d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 00:03:04,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. service=AccessControlService 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd156b2344280434a7e6c12f695d5da4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 00:03:04,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. service=AccessControlService 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,096 INFO [StoreOpener-3bd383710a444ba7fb66ef16d2d841d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,096 INFO [StoreOpener-dd156b2344280434a7e6c12f695d5da4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,101 DEBUG [StoreOpener-3bd383710a444ba7fb66ef16d2d841d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf 2023-09-23 00:03:04,101 DEBUG [StoreOpener-3bd383710a444ba7fb66ef16d2d841d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf 2023-09-23 00:03:04,101 DEBUG [StoreOpener-dd156b2344280434a7e6c12f695d5da4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf 2023-09-23 00:03:04,102 DEBUG [StoreOpener-dd156b2344280434a7e6c12f695d5da4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf 2023-09-23 00:03:04,103 INFO [StoreOpener-dd156b2344280434a7e6c12f695d5da4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd156b2344280434a7e6c12f695d5da4 columnFamilyName cf 2023-09-23 00:03:04,103 INFO [StoreOpener-3bd383710a444ba7fb66ef16d2d841d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bd383710a444ba7fb66ef16d2d841d2 columnFamilyName cf 2023-09-23 00:03:04,104 INFO [StoreOpener-dd156b2344280434a7e6c12f695d5da4-1] regionserver.HStore(310): Store=dd156b2344280434a7e6c12f695d5da4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:04,104 INFO [StoreOpener-3bd383710a444ba7fb66ef16d2d841d2-1] regionserver.HStore(310): Store=3bd383710a444ba7fb66ef16d2d841d2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:04,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:04,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:04,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd156b2344280434a7e6c12f695d5da4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59855073, jitterRate=-0.10808990895748138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:04,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:04,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd156b2344280434a7e6c12f695d5da4: 2023-09-23 00:03:04,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3bd383710a444ba7fb66ef16d2d841d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64049277, jitterRate=-0.04559139907360077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:04,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3bd383710a444ba7fb66ef16d2d841d2: 2023-09-23 00:03:04,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4., pid=61, masterSystemTime=1695427384089 2023-09-23 00:03:04,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2., pid=60, masterSystemTime=1695427384088 2023-09-23 00:03:04,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dd156b2344280434a7e6c12f695d5da4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427384115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427384115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427384115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427384115"}]},"ts":"1695427384115"} 2023-09-23 00:03:04,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,116 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3bd383710a444ba7fb66ef16d2d841d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,116 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427384116"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427384116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427384116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427384116"}]},"ts":"1695427384116"} 2023-09-23 00:03:04,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-23 00:03:04,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure dd156b2344280434a7e6c12f695d5da4, server=jenkins-hbase4.apache.org,37611,1695427312292 in 180 msec 2023-09-23 00:03:04,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-23 00:03:04,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 3bd383710a444ba7fb66ef16d2d841d2, server=jenkins-hbase4.apache.org,42773,1695427312328 in 182 msec 2023-09-23 00:03:04,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, ASSIGN in 341 msec 2023-09-23 00:03:04,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-23 00:03:04,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, ASSIGN in 342 msec 2023-09-23 00:03:04,126 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:03:04,126 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427384126"}]},"ts":"1695427384126"} 2023-09-23 00:03:04,127 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-23 00:03:04,129 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:03:04,129 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-23 00:03:04,131 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 00:03:04,133 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:04,133 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:04,133 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:04,133 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:04,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:04,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:04,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:04,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:04,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 411 msec 2023-09-23 00:03:04,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 00:03:04,331 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-23 00:03:04,334 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,334 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,335 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:03:04,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 00:03:04,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427384347 (current time:1695427384347). 2023-09-23 00:03:04,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:04,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x05feb16e to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:04,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c0d38c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:04,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:04,359 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:04,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05feb16e to 127.0.0.1:52502 2023-09-23 00:03:04,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:04,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x3d95c0e3 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:04,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30d9a98a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:04,367 DEBUG [hconnection-0x101f54ef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:04,368 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:04,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d95c0e3 to 127.0.0.1:52502 2023-09-23 00:03:04,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:04,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 00:03:04,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:04,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 00:03:04,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 00:03:04,375 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 00:03:04,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 00:03:04,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,376 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695427984376 2023-09-23 00:03:04,377 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:04,377 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:04,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 00:03:04,378 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 00:03:04,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 00:03:04,380 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 00:03:04,381 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695427984381 2023-09-23 00:03:04,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,389 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 00:03:04,389 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,391 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 00:03:04,391 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 00:03:04,391 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,391 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,393 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,393 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,393 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,393 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,394 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,394 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,394 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,394 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 00:03:04,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,396 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 00:03:04,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,396 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,396 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 00:03:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 00:03:04,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 00:03:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 00:03:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 00:03:04,399 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 00:03:04,399 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 00:03:04,399 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 00:03:04,399 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 00:03:04,399 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 00:03:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 00:03:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,400 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,400 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a5d9f9c[Count = 1] remaining members to acquire global barrier 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 00:03:04,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a5d9f9c[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:04,405 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 00:03:04,405 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,410 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,410 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,410 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,411 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 00:03:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:04,411 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:04,411 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,411 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,411 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:04,411 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. started... 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:04,411 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. started... 2023-09-23 00:03:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3bd383710a444ba7fb66ef16d2d841d2: 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd156b2344280434a7e6c12f695d5da4: 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:03:04,413 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:03:04,424 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. completed. 2023-09-23 00:03:04,424 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,424 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. completed. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 00:03:04,424 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 00:03:04,424 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:04,433 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 00:03:04,433 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,433 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 00:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 00:03:04,437 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 00:03:04,438 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 00:03:04,438 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,438 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,438 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 00:03:04,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 00:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 00:03:04,446 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 00:03:04,446 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:04,446 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:04,446 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,446 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,452 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,452 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,453 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,454 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,455 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,456 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,456 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,459 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,459 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,461 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,462 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:03:04,462 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,462 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,462 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,463 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,463 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 00:03:04,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,478 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 00:03:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:03:04,479 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:03:04,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 00:03:04,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,489 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695427384376Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695427384473 (+97 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695427384473Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695427384474 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695427384476 (+2 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695427384483 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695427384489 (+6 ms) 2023-09-23 00:03:04,492 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 00:03:04,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 115 msec 2023-09-23 00:03:04,679 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:04,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 00:03:04,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:04,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37611] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:03:04,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:03:04,687 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,687 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,687 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:03:04,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 00:03:04,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427384697 (current time:1695427384697). 2023-09-23 00:03:04,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:04,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x69d36ca2 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:04,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42717ca5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:04,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:04,708 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:04,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69d36ca2 to 127.0.0.1:52502 2023-09-23 00:03:04,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:04,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3a1c58 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:04,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@efed901, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:04,717 DEBUG [hconnection-0x47a3182f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:04,719 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:04,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3a1c58 to 127.0.0.1:52502 2023-09-23 00:03:04,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:04,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 00:03:04,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:04,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 00:03:04,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 00:03:04,727 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 00:03:04,727 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695427984727 2023-09-23 00:03:04,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 00:03:04,729 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:04,729 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:04,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 00:03:04,730 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 00:03:04,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 00:03:04,732 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 00:03:04,732 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695427984732 2023-09-23 00:03:04,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,740 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 00:03:04,740 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,741 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 00:03:04,741 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 00:03:04,741 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,741 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,743 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,743 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,743 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,743 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,743 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,743 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,745 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 00:03:04,745 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 00:03:04,745 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 00:03:04,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,745 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 00:03:04,745 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:04,748 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 00:03:04,749 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 00:03:04,749 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 00:03:04,749 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 00:03:04,749 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 00:03:04,749 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 00:03:04,750 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,750 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,751 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,752 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,752 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,752 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,753 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:04,752 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,753 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,753 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:04,753 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c0254e[Count = 1] remaining members to acquire global barrier 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 00:03:04,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c0254e[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:04,756 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 00:03:04,757 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:04,758 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:04,758 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,759 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:04,758 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,759 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:04,759 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,759 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:04,759 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. started... 2023-09-23 00:03:04,759 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. started... 2023-09-23 00:03:04,759 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dd156b2344280434a7e6c12f695d5da4 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 00:03:04,759 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3bd383710a444ba7fb66ef16d2d841d2 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 00:03:04,760 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 00:03:04,760 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,760 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 00:03:04,778 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923147e1ca009ef434e9902c08f2b12a6aa to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923147e1ca009ef434e9902c08f2b12a6aa 2023-09-23 00:03:04,778 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923e607e46b82344dcabffb13270fb286cd to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923e607e46b82344dcabffb13270fb286cd 2023-09-23 00:03:04,785 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/.tmp/cf/1bee1c1926b84bccb5abd564b7636903 2023-09-23 00:03:04,785 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/.tmp/cf/65a4cc3802a342d6ad68bb0867e4513c 2023-09-23 00:03:04,790 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/.tmp/cf/1bee1c1926b84bccb5abd564b7636903 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf/1bee1c1926b84bccb5abd564b7636903 2023-09-23 00:03:04,790 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/.tmp/cf/65a4cc3802a342d6ad68bb0867e4513c as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf/65a4cc3802a342d6ad68bb0867e4513c 2023-09-23 00:03:04,794 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf/1bee1c1926b84bccb5abd564b7636903, entries=48, sequenceid=6, filesize=13.7 K 2023-09-23 00:03:04,795 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 3bd383710a444ba7fb66ef16d2d841d2 in 36ms, sequenceid=6, compaction requested=false 2023-09-23 00:03:04,795 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-23 00:03:04,796 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3bd383710a444ba7fb66ef16d2d841d2: 2023-09-23 00:03:04,796 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,796 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:04,796 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf/1bee1c1926b84bccb5abd564b7636903] hfiles 2023-09-23 00:03:04,796 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf/1bee1c1926b84bccb5abd564b7636903 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,798 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf/65a4cc3802a342d6ad68bb0867e4513c, entries=2, sequenceid=6, filesize=5.3 K 2023-09-23 00:03:04,798 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for dd156b2344280434a7e6c12f695d5da4 in 39ms, sequenceid=6, compaction requested=false 2023-09-23 00:03:04,800 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd156b2344280434a7e6c12f695d5da4: 2023-09-23 00:03:04,800 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,800 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:04,800 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf/65a4cc3802a342d6ad68bb0867e4513c] hfiles 2023-09-23 00:03:04,800 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf/65a4cc3802a342d6ad68bb0867e4513c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,804 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. completed. 2023-09-23 00:03:04,804 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,805 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 00:03:04,805 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:04,807 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 00:03:04,807 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,807 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,807 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. completed. 2023-09-23 00:03:04,809 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:04,808 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 00:03:04,809 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:04,809 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:04,809 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,809 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 00:03:04,809 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,811 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,811 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 00:03:04,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,812 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,812 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 00:03:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:04,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 00:03:04,818 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 00:03:04,818 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:04,818 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:04,818 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,818 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:04,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,823 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,824 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,824 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:04,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,826 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:04,826 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,827 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,829 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:04,829 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,829 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:03:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,830 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:04,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,830 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:03:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,830 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:04,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:03:04,832 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:04,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:04,833 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,833 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:04,833 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:04,833 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,833 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923147e1ca009ef434e9902c08f2b12a6aa, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923e607e46b82344dcabffb13270fb286cd] mob files 2023-09-23 00:03:04,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923147e1ca009ef434e9902c08f2b12a6aa 2023-09-23 00:03:04,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923e607e46b82344dcabffb13270fb286cd 2023-09-23 00:03:04,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 00:03:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,857 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695427384728Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695427384840 (+112 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695427384840Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695427384840Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695427384843 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695427384850 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695427384857 (+7 ms) 2023-09-23 00:03:04,860 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 00:03:04,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 132 msec 2023-09-23 00:03:05,032 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 00:03:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:05,063 DEBUG [Listener at jenkins-hbase4.apache.org/40639] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 00:03:05,067 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 00:03:05,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37611] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 00:03:05,069 DEBUG [Listener at jenkins-hbase4.apache.org/40639] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 00:03:05,073 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 00:03:05,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 00:03:05,074 DEBUG [Listener at jenkins-hbase4.apache.org/40639] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 00:03:05,078 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 00:03:05,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44515] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 00:03:05,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 00:03:05,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:05,082 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:03:05,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-23 00:03:05,083 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:03:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 00:03:05,085 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,085 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,086 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 empty. 2023-09-23 00:03:05,086 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 empty. 2023-09-23 00:03:05,086 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,086 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 00:03:05,095 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-23 00:03:05,096 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ec41b4a20a2bedad3bfbf8edfc11a78, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:05,096 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => caac4b99fe29a51da24134479faeb3c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:05,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:05,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:05,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 1ec41b4a20a2bedad3bfbf8edfc11a78, disabling compactions & flushes 2023-09-23 00:03:05,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing caac4b99fe29a51da24134479faeb3c8, disabling compactions & flushes 2023-09-23 00:03:05,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. after waiting 0 ms 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. after waiting 0 ms 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,107 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,107 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 1ec41b4a20a2bedad3bfbf8edfc11a78: 2023-09-23 00:03:05,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for caac4b99fe29a51da24134479faeb3c8: 2023-09-23 00:03:05,109 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:03:05,110 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427385110"}]},"ts":"1695427385110"} 2023-09-23 00:03:05,110 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427385110"}]},"ts":"1695427385110"} 2023-09-23 00:03:05,112 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:03:05,113 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:03:05,113 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427385113"}]},"ts":"1695427385113"} 2023-09-23 00:03:05,115 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-23 00:03:05,119 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:03:05,120 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:03:05,120 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:03:05,120 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:03:05,120 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:03:05,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, ASSIGN}] 2023-09-23 00:03:05,123 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, ASSIGN 2023-09-23 00:03:05,123 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, ASSIGN 2023-09-23 00:03:05,124 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37611,1695427312292; forceNewPlan=false, retain=false 2023-09-23 00:03:05,124 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:03:05,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 00:03:05,274 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:03:05,277 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ec41b4a20a2bedad3bfbf8edfc11a78, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:05,277 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=caac4b99fe29a51da24134479faeb3c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:05,277 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427385277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427385277"}]},"ts":"1695427385277"} 2023-09-23 00:03:05,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427385277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427385277"}]},"ts":"1695427385277"} 2023-09-23 00:03:05,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure caac4b99fe29a51da24134479faeb3c8, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:05,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 1ec41b4a20a2bedad3bfbf8edfc11a78, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:05,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 00:03:05,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => caac4b99fe29a51da24134479faeb3c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.', STARTKEY => '2', ENDKEY => ''} 2023-09-23 00:03:05,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ec41b4a20a2bedad3bfbf8edfc11a78, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.', STARTKEY => '', ENDKEY => '2'} 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. service=AccessControlService 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. service=AccessControlService 2023-09-23 00:03:05,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:05,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,436 INFO [StoreOpener-caac4b99fe29a51da24134479faeb3c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,436 INFO [StoreOpener-1ec41b4a20a2bedad3bfbf8edfc11a78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,438 DEBUG [StoreOpener-caac4b99fe29a51da24134479faeb3c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf 2023-09-23 00:03:05,438 DEBUG [StoreOpener-1ec41b4a20a2bedad3bfbf8edfc11a78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf 2023-09-23 00:03:05,438 DEBUG [StoreOpener-1ec41b4a20a2bedad3bfbf8edfc11a78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf 2023-09-23 00:03:05,438 DEBUG [StoreOpener-caac4b99fe29a51da24134479faeb3c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf 2023-09-23 00:03:05,438 INFO [StoreOpener-1ec41b4a20a2bedad3bfbf8edfc11a78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec41b4a20a2bedad3bfbf8edfc11a78 columnFamilyName cf 2023-09-23 00:03:05,438 INFO [StoreOpener-caac4b99fe29a51da24134479faeb3c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region caac4b99fe29a51da24134479faeb3c8 columnFamilyName cf 2023-09-23 00:03:05,439 INFO [StoreOpener-1ec41b4a20a2bedad3bfbf8edfc11a78-1] regionserver.HStore(310): Store=1ec41b4a20a2bedad3bfbf8edfc11a78/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:05,439 INFO [StoreOpener-caac4b99fe29a51da24134479faeb3c8-1] regionserver.HStore(310): Store=caac4b99fe29a51da24134479faeb3c8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:05,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:05,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:05,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ec41b4a20a2bedad3bfbf8edfc11a78; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73381824, jitterRate=0.0934743881225586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:05,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened caac4b99fe29a51da24134479faeb3c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61470367, jitterRate=-0.08402015268802643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:05,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ec41b4a20a2bedad3bfbf8edfc11a78: 2023-09-23 00:03:05,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for caac4b99fe29a51da24134479faeb3c8: 2023-09-23 00:03:05,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8., pid=69, masterSystemTime=1695427385431 2023-09-23 00:03:05,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78., pid=70, masterSystemTime=1695427385431 2023-09-23 00:03:05,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,449 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ec41b4a20a2bedad3bfbf8edfc11a78, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:05,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385449"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427385449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427385449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427385449"}]},"ts":"1695427385449"} 2023-09-23 00:03:05,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,450 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=caac4b99fe29a51da24134479faeb3c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:05,450 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427385450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427385450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427385450"}]},"ts":"1695427385450"} 2023-09-23 00:03:05,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-23 00:03:05,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 1ec41b4a20a2bedad3bfbf8edfc11a78, server=jenkins-hbase4.apache.org,37611,1695427312292 in 171 msec 2023-09-23 00:03:05,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-23 00:03:05,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, ASSIGN in 332 msec 2023-09-23 00:03:05,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure caac4b99fe29a51da24134479faeb3c8, server=jenkins-hbase4.apache.org,42773,1695427312328 in 173 msec 2023-09-23 00:03:05,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-23 00:03:05,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, ASSIGN in 335 msec 2023-09-23 00:03:05,459 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:03:05,459 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427385459"}]},"ts":"1695427385459"} 2023-09-23 00:03:05,460 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-23 00:03:05,462 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:03:05,462 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-23 00:03:05,464 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 00:03:05,465 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:05,465 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:05,465 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:05,465 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:05,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 387 msec 2023-09-23 00:03:05,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 00:03:05,687 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-23 00:03:05,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 1ec41b4a20a2bedad3bfbf8edfc11a78, caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1ec41b4a20a2bedad3bfbf8edfc11a78, caac4b99fe29a51da24134479faeb3c8], force=true 2023-09-23 00:03:05,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1ec41b4a20a2bedad3bfbf8edfc11a78, caac4b99fe29a51da24134479faeb3c8], force=true 2023-09-23 00:03:05,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1ec41b4a20a2bedad3bfbf8edfc11a78, caac4b99fe29a51da24134479faeb3c8], force=true 2023-09-23 00:03:05,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1ec41b4a20a2bedad3bfbf8edfc11a78, caac4b99fe29a51da24134479faeb3c8], force=true 2023-09-23 00:03:05,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 00:03:05,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, UNASSIGN}] 2023-09-23 00:03:05,740 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, UNASSIGN 2023-09-23 00:03:05,740 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, UNASSIGN 2023-09-23 00:03:05,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1ec41b4a20a2bedad3bfbf8edfc11a78, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:05,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=caac4b99fe29a51da24134479faeb3c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:05,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427385741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427385741"}]},"ts":"1695427385741"} 2023-09-23 00:03:05,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427385741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427385741"}]},"ts":"1695427385741"} 2023-09-23 00:03:05,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 1ec41b4a20a2bedad3bfbf8edfc11a78, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:05,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure caac4b99fe29a51da24134479faeb3c8, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:05,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 00:03:05,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing caac4b99fe29a51da24134479faeb3c8, disabling compactions & flushes 2023-09-23 00:03:05,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ec41b4a20a2bedad3bfbf8edfc11a78, disabling compactions & flushes 2023-09-23 00:03:05,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. after waiting 0 ms 2023-09-23 00:03:05,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. after waiting 0 ms 2023-09-23 00:03:05,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing caac4b99fe29a51da24134479faeb3c8 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 00:03:05,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1ec41b4a20a2bedad3bfbf8edfc11a78 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 00:03:05,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/.tmp/cf/1133383c090f4f47bcb6d4710cab9ae5 2023-09-23 00:03:05,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/.tmp/cf/fa43706ff5e840b393e5b3ef0e3008d7 2023-09-23 00:03:05,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/.tmp/cf/fa43706ff5e840b393e5b3ef0e3008d7 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf/fa43706ff5e840b393e5b3ef0e3008d7 2023-09-23 00:03:05,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/.tmp/cf/1133383c090f4f47bcb6d4710cab9ae5 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf/1133383c090f4f47bcb6d4710cab9ae5 2023-09-23 00:03:05,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf/fa43706ff5e840b393e5b3ef0e3008d7, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 00:03:05,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf/1133383c090f4f47bcb6d4710cab9ae5, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 00:03:05,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for caac4b99fe29a51da24134479faeb3c8 in 21ms, sequenceid=5, compaction requested=false 2023-09-23 00:03:05,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 00:03:05,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1ec41b4a20a2bedad3bfbf8edfc11a78 in 28ms, sequenceid=5, compaction requested=false 2023-09-23 00:03:05,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 00:03:05,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 00:03:05,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:05,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8. 2023-09-23 00:03:05,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for caac4b99fe29a51da24134479faeb3c8: 2023-09-23 00:03:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:05,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78. 2023-09-23 00:03:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ec41b4a20a2bedad3bfbf8edfc11a78: 2023-09-23 00:03:05,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:05,933 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=caac4b99fe29a51da24134479faeb3c8, regionState=CLOSED 2023-09-23 00:03:05,933 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427385933"}]},"ts":"1695427385933"} 2023-09-23 00:03:05,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:05,934 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1ec41b4a20a2bedad3bfbf8edfc11a78, regionState=CLOSED 2023-09-23 00:03:05,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695427385934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427385934"}]},"ts":"1695427385934"} 2023-09-23 00:03:05,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-23 00:03:05,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure caac4b99fe29a51da24134479faeb3c8, server=jenkins-hbase4.apache.org,42773,1695427312328 in 192 msec 2023-09-23 00:03:05,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-23 00:03:05,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 1ec41b4a20a2bedad3bfbf8edfc11a78, server=jenkins-hbase4.apache.org,37611,1695427312292 in 193 msec 2023-09-23 00:03:05,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=caac4b99fe29a51da24134479faeb3c8, UNASSIGN in 199 msec 2023-09-23 00:03:05,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-23 00:03:05,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ec41b4a20a2bedad3bfbf8edfc11a78, UNASSIGN in 201 msec 2023-09-23 00:03:05,977 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-23 00:03:05,979 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385079.1ec41b4a20a2bedad3bfbf8edfc11a78.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:05,979 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695427385079.caac4b99fe29a51da24134479faeb3c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:05,979 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:06,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 00:03:06,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, ASSIGN}] 2023-09-23 00:03:06,028 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, ASSIGN 2023-09-23 00:03:06,029 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37611,1695427312292; forceNewPlan=false, retain=false 2023-09-23 00:03:06,179 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 00:03:06,181 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0d7e689bfe86780724fc5e7a37c747de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,181 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695427386181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427386181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427386181"}]},"ts":"1695427386181"} 2023-09-23 00:03:06,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0d7e689bfe86780724fc5e7a37c747de, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:06,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 00:03:06,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:06,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d7e689bfe86780724fc5e7a37c747de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.', STARTKEY => '', ENDKEY => ''} 2023-09-23 00:03:06,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. service=AccessControlService 2023-09-23 00:03:06,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:06,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:06,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/.regioninfo 2023-09-23 00:03:06,347 INFO [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,348 DEBUG [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf 2023-09-23 00:03:06,348 DEBUG [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf 2023-09-23 00:03:06,349 INFO [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d7e689bfe86780724fc5e7a37c747de columnFamilyName cf 2023-09-23 00:03:06,375 DEBUG [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] regionserver.HStore(539): loaded hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/1133383c090f4f47bcb6d4710cab9ae5.1ec41b4a20a2bedad3bfbf8edfc11a78->hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf/1133383c090f4f47bcb6d4710cab9ae5-top 2023-09-23 00:03:06,380 DEBUG [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] regionserver.HStore(539): loaded hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/fa43706ff5e840b393e5b3ef0e3008d7.caac4b99fe29a51da24134479faeb3c8->hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf/fa43706ff5e840b393e5b3ef0e3008d7-top 2023-09-23 00:03:06,381 INFO [StoreOpener-0d7e689bfe86780724fc5e7a37c747de-1] regionserver.HStore(310): Store=0d7e689bfe86780724fc5e7a37c747de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:06,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:06,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d7e689bfe86780724fc5e7a37c747de; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65971108, jitterRate=-0.016953885555267334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:06,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d7e689bfe86780724fc5e7a37c747de: 2023-09-23 00:03:06,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de., pid=77, masterSystemTime=1695427386334 2023-09-23 00:03:06,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.,because compaction is disabled. 2023-09-23 00:03:06,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:06,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:06,390 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0d7e689bfe86780724fc5e7a37c747de, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,390 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695427386389"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427386389"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427386389"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427386389"}]},"ts":"1695427386389"} 2023-09-23 00:03:06,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-23 00:03:06,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0d7e689bfe86780724fc5e7a37c747de, server=jenkins-hbase4.apache.org,37611,1695427312292 in 208 msec 2023-09-23 00:03:06,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-23 00:03:06,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, ASSIGN in 366 msec 2023-09-23 00:03:06,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1ec41b4a20a2bedad3bfbf8edfc11a78, caac4b99fe29a51da24134479faeb3c8], force=true in 684 msec 2023-09-23 00:03:06,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 00:03:06,824 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-23 00:03:06,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 00:03:06,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427386825 (current time:1695427386825). 2023-09-23 00:03:06,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:06,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x78825fbe to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:06,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30394ede, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:06,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:06,837 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:06,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78825fbe to 127.0.0.1:52502 2023-09-23 00:03:06,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:06,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x6458359e to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:06,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e4de904, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:06,849 DEBUG [hconnection-0x747819ad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:06,850 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:06,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6458359e to 127.0.0.1:52502 2023-09-23 00:03:06,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:06,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 00:03:06,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:06,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 00:03:06,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 00:03:06,860 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 00:03:06,860 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695427986860 2023-09-23 00:03:06,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 00:03:06,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,864 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:06,864 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:06,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 00:03:06,865 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 00:03:06,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-23 00:03:06,867 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 00:03:06,868 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695427986868 2023-09-23 00:03:06,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,876 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 00:03:06,876 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:06,877 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-23 00:03:06,877 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-23 00:03:06,878 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,878 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,879 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:06,879 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:06,879 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:06,879 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,880 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,880 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 00:03:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 00:03:06,881 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 00:03:06,881 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:06,881 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 00:03:06,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 00:03:06,882 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 00:03:06,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 00:03:06,882 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:06,883 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 00:03:06,883 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 00:03:06,883 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 00:03:06,883 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 00:03:06,882 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:06,884 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 00:03:06,884 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 00:03:06,884 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 00:03:06,886 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,886 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,886 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:06,886 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,886 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,886 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:06,886 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,887 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:06,887 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,887 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:06,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-23 00:03:06,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fb21fb4[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:06,888 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-23 00:03:06,889 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,890 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,890 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:06,891 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:06,891 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:06,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:06,891 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:06,891 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:06,892 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. started... 2023-09-23 00:03:06,893 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d7e689bfe86780724fc5e7a37c747de: 2023-09-23 00:03:06,893 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 00:03:06,893 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:06,893 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 00:03:06,893 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,894 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:06,894 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 00:03:06,894 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:06,894 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 00:03:06,897 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/1133383c090f4f47bcb6d4710cab9ae5.1ec41b4a20a2bedad3bfbf8edfc11a78->hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf/1133383c090f4f47bcb6d4710cab9ae5-top, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/fa43706ff5e840b393e5b3ef0e3008d7.caac4b99fe29a51da24134479faeb3c8->hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf/fa43706ff5e840b393e5b3ef0e3008d7-top] hfiles 2023-09-23 00:03:06,897 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/1133383c090f4f47bcb6d4710cab9ae5.1ec41b4a20a2bedad3bfbf8edfc11a78 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,898 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/fa43706ff5e840b393e5b3ef0e3008d7.caac4b99fe29a51da24134479faeb3c8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,905 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. completed. 2023-09-23 00:03:06,905 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:06,905 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:06,905 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:06,905 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,905 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 00:03:06,905 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:06,911 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 00:03:06,911 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,911 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,911 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 00:03:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:06,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-23 00:03:06,914 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-23 00:03:06,914 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:06,914 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:06,914 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,915 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,916 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:06,917 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:06,917 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,918 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,919 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,920 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:06,920 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:06,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:06,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:06,923 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:06,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:06,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:06,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:06,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,924 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:06,925 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:06,925 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:06,925 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:06,925 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:06,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:06,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:06,925 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:06,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:06,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:06,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,925 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:06,925 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:06,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-23 00:03:06,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,950 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695427386861Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695427386925 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695427386925Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695427386928 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695427386942 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695427386949 (+7 ms) 2023-09-23 00:03:06,952 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 00:03:06,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 88 msec 2023-09-23 00:03:06,964 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:06,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-23 00:03:06,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:06,966 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966 2023-09-23 00:03:06,966 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33037, tgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966, rawTgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:03:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:03:06,988 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1404950541_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:06,988 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-23 00:03:06,996 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:07,011 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,012 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,012 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,013 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0004_000001 (auth:SIMPLE) 2023-09-23 00:03:07,923 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-5791865169888316850.jar 2023-09-23 00:03:07,924 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,924 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,990 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-303561294953179525.jar 2023-09-23 00:03:07,990 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,991 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,991 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,992 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,992 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,992 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:07,993 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:03:07,993 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:03:07,993 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:03:07,994 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:03:07,994 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:03:07,994 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:03:07,995 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:03:07,995 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:03:07,995 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:03:07,996 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:03:07,996 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:07,997 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:07,997 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:07,998 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:07,998 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:07,998 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:07,999 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:08,343 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:03:08,345 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-23 00:03:08,347 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-23 00:03:08,397 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:03:08,397 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:03:08,641 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0005_000001 (auth:SIMPLE) 2023-09-23 00:03:08,994 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:03:12,323 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0005_000001 (auth:SIMPLE) 2023-09-23 00:03:14,532 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0005_000001 (auth:SIMPLE) 2023-09-23 00:03:16,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0005_000001 (auth:SIMPLE) 2023-09-23 00:03:18,517 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:03:18,520 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:03:18,528 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,528 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:03:18,529 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:03:18,529 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,529 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 00:03:18,529 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 00:03:18,529 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 00:03:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427386966/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 00:03:18,536 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 00:03:18,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427398540"}]},"ts":"1695427398540"} 2023-09-23 00:03:18,542 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-23 00:03:18,543 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-23 00:03:18,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, UNASSIGN}] 2023-09-23 00:03:18,546 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, UNASSIGN 2023-09-23 00:03:18,547 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0d7e689bfe86780724fc5e7a37c747de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:18,547 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695427398547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427398547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427398547"}]},"ts":"1695427398547"} 2023-09-23 00:03:18,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0d7e689bfe86780724fc5e7a37c747de, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:18,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 00:03:18,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:18,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d7e689bfe86780724fc5e7a37c747de, disabling compactions & flushes 2023-09-23 00:03:18,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:18,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:18,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. after waiting 0 ms 2023-09-23 00:03:18,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:18,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-23 00:03:18,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:18,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de. 2023-09-23 00:03:18,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d7e689bfe86780724fc5e7a37c747de: 2023-09-23 00:03:18,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:18,714 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0d7e689bfe86780724fc5e7a37c747de, regionState=CLOSED 2023-09-23 00:03:18,714 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695427398714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427398714"}]},"ts":"1695427398714"} 2023-09-23 00:03:18,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-23 00:03:18,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0d7e689bfe86780724fc5e7a37c747de, server=jenkins-hbase4.apache.org,37611,1695427312292 in 168 msec 2023-09-23 00:03:18,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-23 00:03:18,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d7e689bfe86780724fc5e7a37c747de, UNASSIGN in 173 msec 2023-09-23 00:03:18,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427398719"}]},"ts":"1695427398719"} 2023-09-23 00:03:18,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-23 00:03:18,722 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-23 00:03:18,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-23 00:03:18,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 00:03:18,843 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-23 00:03:18,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,846 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,847 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,848 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,851 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:18,851 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:18,851 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:18,853 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,853 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,853 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,853 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,853 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/recovered.edits] 2023-09-23 00:03:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 00:03:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 00:03:18,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 00:03:18,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/recovered.edits] 2023-09-23 00:03:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 00:03:18,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/recovered.edits] 2023-09-23 00:03:18,854 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,854 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,855 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,854 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,855 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:18,855 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:18,855 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:18,854 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:18,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:18,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:18,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:18,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:18,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 00:03:18,859 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf/fa43706ff5e840b393e5b3ef0e3008d7 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/cf/fa43706ff5e840b393e5b3ef0e3008d7 2023-09-23 00:03:18,859 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/1133383c090f4f47bcb6d4710cab9ae5.1ec41b4a20a2bedad3bfbf8edfc11a78 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/1133383c090f4f47bcb6d4710cab9ae5.1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:18,860 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf/1133383c090f4f47bcb6d4710cab9ae5 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/cf/1133383c090f4f47bcb6d4710cab9ae5 2023-09-23 00:03:18,861 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/fa43706ff5e840b393e5b3ef0e3008d7.caac4b99fe29a51da24134479faeb3c8 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/cf/fa43706ff5e840b393e5b3ef0e3008d7.caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:18,862 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/recovered.edits/8.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8/recovered.edits/8.seqid 2023-09-23 00:03:18,863 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/caac4b99fe29a51da24134479faeb3c8 2023-09-23 00:03:18,864 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/recovered.edits/12.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de/recovered.edits/12.seqid 2023-09-23 00:03:18,865 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/recovered.edits/8.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78/recovered.edits/8.seqid 2023-09-23 00:03:18,865 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d7e689bfe86780724fc5e7a37c747de 2023-09-23 00:03:18,865 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ec41b4a20a2bedad3bfbf8edfc11a78 2023-09-23 00:03:18,865 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 00:03:18,867 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,869 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-23 00:03:18,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-23 00:03:18,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-23 00:03:18,872 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427398872"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:18,874 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-23 00:03:18,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0d7e689bfe86780724fc5e7a37c747de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695427385080.0d7e689bfe86780724fc5e7a37c747de.', STARTKEY => '', ENDKEY => ''}] 2023-09-23 00:03:18,874 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-23 00:03:18,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427398874"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:18,875 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-23 00:03:18,877 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:18,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-23 00:03:18,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 00:03:18,958 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-23 00:03:18,958 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:18,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:18,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 00:03:18,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427398963"}]},"ts":"1695427398963"} 2023-09-23 00:03:18,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-23 00:03:18,966 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-23 00:03:18,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, UNASSIGN}] 2023-09-23 00:03:18,968 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, UNASSIGN 2023-09-23 00:03:18,968 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, UNASSIGN 2023-09-23 00:03:18,969 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dd156b2344280434a7e6c12f695d5da4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:18,969 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3bd383710a444ba7fb66ef16d2d841d2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:18,969 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427398969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427398969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427398969"}]},"ts":"1695427398969"} 2023-09-23 00:03:18,969 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427398969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427398969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427398969"}]},"ts":"1695427398969"} 2023-09-23 00:03:18,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure dd156b2344280434a7e6c12f695d5da4, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:18,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 3bd383710a444ba7fb66ef16d2d841d2, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:19,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 00:03:19,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:19,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd156b2344280434a7e6c12f695d5da4, disabling compactions & flushes 2023-09-23 00:03:19,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:19,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:19,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. after waiting 0 ms 2023-09-23 00:03:19,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:19,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:19,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3bd383710a444ba7fb66ef16d2d841d2, disabling compactions & flushes 2023-09-23 00:03:19,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:19,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:19,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. after waiting 0 ms 2023-09-23 00:03:19,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:19,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:19,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:19,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4. 2023-09-23 00:03:19,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd156b2344280434a7e6c12f695d5da4: 2023-09-23 00:03:19,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:19,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:19,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2. 2023-09-23 00:03:19,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3bd383710a444ba7fb66ef16d2d841d2: 2023-09-23 00:03:19,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:19,139 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dd156b2344280434a7e6c12f695d5da4, regionState=CLOSED 2023-09-23 00:03:19,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:19,139 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427399139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427399139"}]},"ts":"1695427399139"} 2023-09-23 00:03:19,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3bd383710a444ba7fb66ef16d2d841d2, regionState=CLOSED 2023-09-23 00:03:19,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695427399140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427399140"}]},"ts":"1695427399140"} 2023-09-23 00:03:19,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-23 00:03:19,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure dd156b2344280434a7e6c12f695d5da4, server=jenkins-hbase4.apache.org,37611,1695427312292 in 169 msec 2023-09-23 00:03:19,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-23 00:03:19,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 3bd383710a444ba7fb66ef16d2d841d2, server=jenkins-hbase4.apache.org,42773,1695427312328 in 169 msec 2023-09-23 00:03:19,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd156b2344280434a7e6c12f695d5da4, UNASSIGN in 176 msec 2023-09-23 00:03:19,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-23 00:03:19,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3bd383710a444ba7fb66ef16d2d841d2, UNASSIGN in 177 msec 2023-09-23 00:03:19,145 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427399145"}]},"ts":"1695427399145"} 2023-09-23 00:03:19,146 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-23 00:03:19,149 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-23 00:03:19,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-09-23 00:03:19,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 00:03:19,265 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-23 00:03:19,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,269 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,269 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,271 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,273 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,273 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,273 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,274 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 00:03:19,274 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:19,274 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:19,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 00:03:19,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,275 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 00:03:19,275 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 00:03:19,276 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/recovered.edits] 2023-09-23 00:03:19,276 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/recovered.edits] 2023-09-23 00:03:19,280 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf/65a4cc3802a342d6ad68bb0867e4513c to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/cf/65a4cc3802a342d6ad68bb0867e4513c 2023-09-23 00:03:19,280 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf/1bee1c1926b84bccb5abd564b7636903 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/cf/1bee1c1926b84bccb5abd564b7636903 2023-09-23 00:03:19,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4/recovered.edits/9.seqid 2023-09-23 00:03:19,283 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2/recovered.edits/9.seqid 2023-09-23 00:03:19,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd156b2344280434a7e6c12f695d5da4 2023-09-23 00:03:19,283 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3bd383710a444ba7fb66ef16d2d841d2 2023-09-23 00:03:19,283 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 00:03:19,284 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 00:03:19,284 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-23 00:03:19,287 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923147e1ca009ef434e9902c08f2b12a6aa to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923147e1ca009ef434e9902c08f2b12a6aa 2023-09-23 00:03:19,289 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923e607e46b82344dcabffb13270fb286cd to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923e607e46b82344dcabffb13270fb286cd 2023-09-23 00:03:19,289 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 00:03:19,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,293 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-23 00:03:19,295 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-23 00:03:19,296 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,296 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-23 00:03:19,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427399296"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:19,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427399296"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:19,298 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 00:03:19,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dd156b2344280434a7e6c12f695d5da4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695427383723.dd156b2344280434a7e6c12f695d5da4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3bd383710a444ba7fb66ef16d2d841d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695427383723.3bd383710a444ba7fb66ef16d2d841d2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 00:03:19,298 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-23 00:03:19,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427399298"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:19,300 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-23 00:03:19,303 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-23 00:03:19,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 00:03:19,378 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-23 00:03:19,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 00:03:19,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 00:03:19,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 00:03:19,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-23 00:03:19,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 00:03:19,417 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 751) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3954 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:41495 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2099418536_1 at /127.0.0.1:35496 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2099418536_1 at /127.0.0.1:58046 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:35514 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:58064 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:36902 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 193), ProcessCount=171 (was 171), AvailableMemoryMB=1228 (was 1319) 2023-09-23 00:03:19,417 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-23 00:03:19,436 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=166, ProcessCount=171, AvailableMemoryMB=1227 2023-09-23 00:03:19,436 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-23 00:03:19,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 00:03:19,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:19,441 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:03:19,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-23 00:03:19,442 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:03:19,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 00:03:19,444 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,444 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,444 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 empty. 2023-09-23 00:03:19,444 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 empty. 2023-09-23 00:03:19,445 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,445 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,445 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 00:03:19,453 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 00:03:19,454 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => adb3dc4192a8d4057d8c0b1d7379f6f3, NAME => 'testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:19,454 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a364ef265fa51b1a230d745c9b2c41c6, NAME => 'testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing adb3dc4192a8d4057d8c0b1d7379f6f3, disabling compactions & flushes 2023-09-23 00:03:19,465 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. after waiting 0 ms 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,465 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for adb3dc4192a8d4057d8c0b1d7379f6f3: 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a364ef265fa51b1a230d745c9b2c41c6, disabling compactions & flushes 2023-09-23 00:03:19,465 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. after waiting 0 ms 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,465 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,465 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a364ef265fa51b1a230d745c9b2c41c6: 2023-09-23 00:03:19,467 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:03:19,468 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427399468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427399468"}]},"ts":"1695427399468"} 2023-09-23 00:03:19,468 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427399468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427399468"}]},"ts":"1695427399468"} 2023-09-23 00:03:19,470 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:03:19,471 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:03:19,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427399471"}]},"ts":"1695427399471"} 2023-09-23 00:03:19,472 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 00:03:19,475 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:03:19,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:03:19,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:03:19,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:03:19,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:03:19,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, ASSIGN}] 2023-09-23 00:03:19,478 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, ASSIGN 2023-09-23 00:03:19,479 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, ASSIGN 2023-09-23 00:03:19,479 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1695427312328; forceNewPlan=false, retain=false 2023-09-23 00:03:19,479 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37611,1695427312292; forceNewPlan=false, retain=false 2023-09-23 00:03:19,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 00:03:19,629 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:03:19,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=adb3dc4192a8d4057d8c0b1d7379f6f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:19,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a364ef265fa51b1a230d745c9b2c41c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:19,632 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427399632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427399632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427399632"}]},"ts":"1695427399632"} 2023-09-23 00:03:19,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427399632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427399632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427399632"}]},"ts":"1695427399632"} 2023-09-23 00:03:19,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure adb3dc4192a8d4057d8c0b1d7379f6f3, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:19,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure a364ef265fa51b1a230d745c9b2c41c6, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:19,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 00:03:19,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adb3dc4192a8d4057d8c0b1d7379f6f3, NAME => 'testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 00:03:19,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a364ef265fa51b1a230d745c9b2c41c6, NAME => 'testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. service=AccessControlService 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. service=AccessControlService 2023-09-23 00:03:19,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:19,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,791 INFO [StoreOpener-adb3dc4192a8d4057d8c0b1d7379f6f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,791 INFO [StoreOpener-a364ef265fa51b1a230d745c9b2c41c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,792 DEBUG [StoreOpener-adb3dc4192a8d4057d8c0b1d7379f6f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf 2023-09-23 00:03:19,792 DEBUG [StoreOpener-a364ef265fa51b1a230d745c9b2c41c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf 2023-09-23 00:03:19,792 DEBUG [StoreOpener-adb3dc4192a8d4057d8c0b1d7379f6f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf 2023-09-23 00:03:19,792 DEBUG [StoreOpener-a364ef265fa51b1a230d745c9b2c41c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf 2023-09-23 00:03:19,792 INFO [StoreOpener-a364ef265fa51b1a230d745c9b2c41c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a364ef265fa51b1a230d745c9b2c41c6 columnFamilyName cf 2023-09-23 00:03:19,792 INFO [StoreOpener-adb3dc4192a8d4057d8c0b1d7379f6f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adb3dc4192a8d4057d8c0b1d7379f6f3 columnFamilyName cf 2023-09-23 00:03:19,794 INFO [StoreOpener-a364ef265fa51b1a230d745c9b2c41c6-1] regionserver.HStore(310): Store=a364ef265fa51b1a230d745c9b2c41c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:19,794 INFO [StoreOpener-adb3dc4192a8d4057d8c0b1d7379f6f3-1] regionserver.HStore(310): Store=adb3dc4192a8d4057d8c0b1d7379f6f3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:19,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:19,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:19,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:19,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:19,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened adb3dc4192a8d4057d8c0b1d7379f6f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60474646, jitterRate=-0.09885755181312561}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:19,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a364ef265fa51b1a230d745c9b2c41c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63489900, jitterRate=-0.05392676591873169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:19,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for adb3dc4192a8d4057d8c0b1d7379f6f3: 2023-09-23 00:03:19,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a364ef265fa51b1a230d745c9b2c41c6: 2023-09-23 00:03:19,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3., pid=93, masterSystemTime=1695427399785 2023-09-23 00:03:19,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:19,803 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=adb3dc4192a8d4057d8c0b1d7379f6f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:19,803 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427399803"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427399803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427399803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427399803"}]},"ts":"1695427399803"} 2023-09-23 00:03:19,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6., pid=94, masterSystemTime=1695427399786 2023-09-23 00:03:19,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:19,805 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a364ef265fa51b1a230d745c9b2c41c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:19,805 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427399805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427399805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427399805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427399805"}]},"ts":"1695427399805"} 2023-09-23 00:03:19,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-23 00:03:19,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure adb3dc4192a8d4057d8c0b1d7379f6f3, server=jenkins-hbase4.apache.org,37611,1695427312292 in 170 msec 2023-09-23 00:03:19,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, ASSIGN in 330 msec 2023-09-23 00:03:19,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-23 00:03:19,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure a364ef265fa51b1a230d745c9b2c41c6, server=jenkins-hbase4.apache.org,42773,1695427312328 in 173 msec 2023-09-23 00:03:19,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-23 00:03:19,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, ASSIGN in 332 msec 2023-09-23 00:03:19,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:03:19,810 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427399810"}]},"ts":"1695427399810"} 2023-09-23 00:03:19,811 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 00:03:19,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:03:19,813 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-23 00:03:19,815 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 00:03:19,817 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,817 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,817 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,817 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:19,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:19,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:19,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:19,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:19,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 380 msec 2023-09-23 00:03:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 00:03:20,045 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-23 00:03:20,047 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:20,048 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:20,049 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:03:20,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:03:20,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427400059 (current time:1695427400059). 2023-09-23 00:03:20,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:20,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x685f2df6 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:20,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e099b06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:20,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:20,072 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:20,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x685f2df6 to 127.0.0.1:52502 2023-09-23 00:03:20,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:20,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x7bc99e5f to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:20,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ae83c4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:20,082 DEBUG [hconnection-0x287b4bbd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:20,084 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:20,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bc99e5f to 127.0.0.1:52502 2023-09-23 00:03:20,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:20,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 00:03:20,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:20,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:03:20,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:03:20,092 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:03:20,093 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695428000093 2023-09-23 00:03:20,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:03:20,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:20,094 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:20,094 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:20,095 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:03:20,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 00:03:20,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-23 00:03:20,099 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 00:03:20,099 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695428000099 2023-09-23 00:03:20,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,108 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-23 00:03:20,108 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,109 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 00:03:20,109 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 00:03:20,109 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,109 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,120 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,120 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,120 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,120 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,121 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,121 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,121 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,121 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:20,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 00:03:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 00:03:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 00:03:20,123 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 00:03:20,123 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,124 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 00:03:20,125 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 00:03:20,125 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 00:03:20,123 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 00:03:20,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 00:03:20,125 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 00:03:20,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 00:03:20,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 00:03:20,128 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,128 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,129 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,129 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 00:03:20,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@338ef6df[Count = 1] remaining members to acquire global barrier 2023-09-23 00:03:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 00:03:20,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@338ef6df[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:20,134 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 00:03:20,134 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,135 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,135 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:03:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,136 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:03:20,136 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:20,136 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:03:20,136 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:20,137 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:20,136 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. started... 2023-09-23 00:03:20,137 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. started... 2023-09-23 00:03:20,136 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 00:03:20,137 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:20,137 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adb3dc4192a8d4057d8c0b1d7379f6f3: 2023-09-23 00:03:20,138 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a364ef265fa51b1a230d745c9b2c41c6: 2023-09-23 00:03:20,138 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,138 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:20,138 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,138 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:03:20,138 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:20,139 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:03:20,139 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 00:03:20,140 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,140 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 00:03:20,150 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. completed. 2023-09-23 00:03:20,150 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. completed. 2023-09-23 00:03:20,150 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:20,150 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 00:03:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 00:03:20,153 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,153 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 00:03:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 00:03:20,154 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 00:03:20,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:20,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:03:20,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 00:03:20,161 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 00:03:20,161 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:20,161 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:20,161 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,161 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,164 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,164 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,164 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,166 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,166 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,167 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,169 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,170 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:20,170 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,169 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:03:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,170 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,171 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,171 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,171 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,172 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,172 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 00:03:20,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,194 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:03:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:03:20,196 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:03:20,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,205 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 00:03:20,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,205 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695427400093Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695427400179 (+86 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695427400179Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695427400179Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695427400189 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695427400199 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695427400205 (+6 ms) 2023-09-23 00:03:20,209 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 00:03:20,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 115 msec 2023-09-23 00:03:20,396 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:20,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:03:20,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:20,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37611] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:03:20,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:03:20,403 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:20,403 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:20,403 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:03:20,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:03:20,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427400412 (current time:1695427400412). 2023-09-23 00:03:20,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:20,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x43edb471 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:20,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31393912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:20,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:20,421 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:20,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43edb471 to 127.0.0.1:52502 2023-09-23 00:03:20,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:20,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x64d6d6cf to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:20,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab6b818, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:20,429 DEBUG [hconnection-0x323ff9f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:20,431 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:20,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64d6d6cf to 127.0.0.1:52502 2023-09-23 00:03:20,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:20,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 00:03:20,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:20,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:03:20,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:03:20,439 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:03:20,439 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695428000439 2023-09-23 00:03:20,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 00:03:20,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:20,441 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:20,442 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 00:03:20,442 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:20,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 00:03:20,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-23 00:03:20,443 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 00:03:20,444 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695428000444 2023-09-23 00:03:20,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,453 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-23 00:03:20,453 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,454 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 00:03:20,454 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 00:03:20,454 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,454 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,456 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,456 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,456 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,456 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,457 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,457 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 00:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,458 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 00:03:20,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,458 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 00:03:20,458 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 00:03:20,458 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 00:03:20,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:20,460 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 00:03:20,463 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 00:03:20,463 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 00:03:20,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 00:03:20,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 00:03:20,463 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 00:03:20,467 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,467 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,468 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,468 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:20,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55493e4d[Count = 1] remaining members to acquire global barrier 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 00:03:20,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55493e4d[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:20,471 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 00:03:20,471 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,475 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,475 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,475 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:03:20,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,476 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:03:20,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 00:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:20,476 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,476 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:20,476 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:20,476 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:20,476 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. started... 2023-09-23 00:03:20,476 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. started... 2023-09-23 00:03:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:20,477 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing adb3dc4192a8d4057d8c0b1d7379f6f3 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-23 00:03:20,477 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a364ef265fa51b1a230d745c9b2c41c6 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-23 00:03:20,479 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 00:03:20,479 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,479 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 00:03:20,497 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309236127139b01d54c9b8a496bfc1d8c991d to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309236127139b01d54c9b8a496bfc1d8c991d 2023-09-23 00:03:20,497 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309233267f64ae16843bc907e71a1b9f937d0 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309233267f64ae16843bc907e71a1b9f937d0 2023-09-23 00:03:20,505 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/.tmp/cf/ca52960eccd445cab955a25d4f385784 2023-09-23 00:03:20,505 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/.tmp/cf/497977c856fe422480ae4121e323aa69 2023-09-23 00:03:20,510 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/.tmp/cf/ca52960eccd445cab955a25d4f385784 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf/ca52960eccd445cab955a25d4f385784 2023-09-23 00:03:20,510 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/.tmp/cf/497977c856fe422480ae4121e323aa69 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf/497977c856fe422480ae4121e323aa69 2023-09-23 00:03:20,514 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf/497977c856fe422480ae4121e323aa69, entries=44, sequenceid=6, filesize=12.6 K 2023-09-23 00:03:20,515 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf/ca52960eccd445cab955a25d4f385784, entries=6, sequenceid=6, filesize=5.9 K 2023-09-23 00:03:20,515 INFO [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for a364ef265fa51b1a230d745c9b2c41c6 in 39ms, sequenceid=6, compaction requested=false 2023-09-23 00:03:20,515 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-23 00:03:20,516 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for adb3dc4192a8d4057d8c0b1d7379f6f3 in 40ms, sequenceid=6, compaction requested=false 2023-09-23 00:03:20,516 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-23 00:03:20,518 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a364ef265fa51b1a230d745c9b2c41c6: 2023-09-23 00:03:20,518 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adb3dc4192a8d4057d8c0b1d7379f6f3: 2023-09-23 00:03:20,518 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,518 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:20,519 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,519 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf/497977c856fe422480ae4121e323aa69] hfiles 2023-09-23 00:03:20,519 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:20,519 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf/497977c856fe422480ae4121e323aa69 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,519 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf/ca52960eccd445cab955a25d4f385784] hfiles 2023-09-23 00:03:20,519 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf/ca52960eccd445cab955a25d4f385784 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,529 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. completed. 2023-09-23 00:03:20,530 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:20,530 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. completed. 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:20,530 DEBUG [rs(jenkins-hbase4.apache.org,42773,1695427312328)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 00:03:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:20,532 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 00:03:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,532 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 00:03:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 00:03:20,533 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,533 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 00:03:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1695427312328': 2023-09-23 00:03:20,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 00:03:20,540 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 00:03:20,540 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:20,540 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:20,540 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,540 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:20,542 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:20,542 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,542 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:20,543 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:03:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,543 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:20,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:03:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,544 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:03:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,544 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:20,544 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:20,546 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,546 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,546 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,549 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:20,551 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:20,549 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:20,551 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,551 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:20,551 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:20,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:03:20,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,551 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:20,552 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:20,552 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:20,552 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,552 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309233267f64ae16843bc907e71a1b9f937d0, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309236127139b01d54c9b8a496bfc1d8c991d] mob files 2023-09-23 00:03:20,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309233267f64ae16843bc907e71a1b9f937d0 2023-09-23 00:03:20,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309236127139b01d54c9b8a496bfc1d8c991d 2023-09-23 00:03:20,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,584 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 00:03:20,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,585 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695427400440Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695427400560 (+120 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695427400560Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695427400560Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695427400565 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695427400576 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695427400584 (+8 ms) 2023-09-23 00:03:20,588 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 00:03:20,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 147 msec 2023-09-23 00:03:20,744 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:20,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 00:03:20,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:20,745 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745 2023-09-23 00:03:20,745 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33037, tgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745, rawTgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2086093069_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,767 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-23 00:03:20,772 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:20,790 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:20,791 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:20,791 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:20,791 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,662 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-7015854734300583248.jar 2023-09-23 00:03:21,662 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,663 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,729 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-1791360966074810047.jar 2023-09-23 00:03:21,729 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,729 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,730 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,730 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,730 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,731 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:21,731 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:03:21,731 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:03:21,732 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:03:21,732 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:03:21,732 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:03:21,733 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:03:21,733 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:03:21,734 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:03:21,734 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:03:21,734 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:03:21,735 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:21,735 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:21,736 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:21,736 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:21,736 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:21,737 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:21,737 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:22,103 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:03:22,105 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-23 00:03:23,036 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:03:23,036 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:03:23,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0005_000001 (auth:SIMPLE) 2023-09-23 00:03:23,863 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0006_000001 (auth:SIMPLE) 2023-09-23 00:03:24,300 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:03:27,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0006_000001 (auth:SIMPLE) 2023-09-23 00:03:30,439 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:03:30,440 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:03:30,445 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:30,445 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:03:30,445 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:03:30,446 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:30,446 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 00:03:30,446 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 00:03:30,446 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:30,447 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 00:03:30,447 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427400745/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 00:03:30,453 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 00:03:30,457 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427410457"}]},"ts":"1695427410457"} 2023-09-23 00:03:30,459 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 00:03:30,463 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-23 00:03:30,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, UNASSIGN}] 2023-09-23 00:03:30,468 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, UNASSIGN 2023-09-23 00:03:30,468 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, UNASSIGN 2023-09-23 00:03:30,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=adb3dc4192a8d4057d8c0b1d7379f6f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:30,469 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a364ef265fa51b1a230d745c9b2c41c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:30,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427410469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427410469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427410469"}]},"ts":"1695427410469"} 2023-09-23 00:03:30,469 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427410469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427410469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427410469"}]},"ts":"1695427410469"} 2023-09-23 00:03:30,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure adb3dc4192a8d4057d8c0b1d7379f6f3, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:30,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure a364ef265fa51b1a230d745c9b2c41c6, server=jenkins-hbase4.apache.org,42773,1695427312328}] 2023-09-23 00:03:30,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 00:03:30,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:30,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing adb3dc4192a8d4057d8c0b1d7379f6f3, disabling compactions & flushes 2023-09-23 00:03:30,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:30,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:30,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. after waiting 0 ms 2023-09-23 00:03:30,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:30,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:30,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a364ef265fa51b1a230d745c9b2c41c6, disabling compactions & flushes 2023-09-23 00:03:30,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:30,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:30,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. after waiting 0 ms 2023-09-23 00:03:30,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:30,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:30,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:30,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:30,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3. 2023-09-23 00:03:30,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for adb3dc4192a8d4057d8c0b1d7379f6f3: 2023-09-23 00:03:30,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:30,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6. 2023-09-23 00:03:30,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a364ef265fa51b1a230d745c9b2c41c6: 2023-09-23 00:03:30,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:30,637 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=adb3dc4192a8d4057d8c0b1d7379f6f3, regionState=CLOSED 2023-09-23 00:03:30,637 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427410637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427410637"}]},"ts":"1695427410637"} 2023-09-23 00:03:30,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:30,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a364ef265fa51b1a230d745c9b2c41c6, regionState=CLOSED 2023-09-23 00:03:30,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695427410638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427410638"}]},"ts":"1695427410638"} 2023-09-23 00:03:30,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-23 00:03:30,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure adb3dc4192a8d4057d8c0b1d7379f6f3, server=jenkins-hbase4.apache.org,37611,1695427312292 in 168 msec 2023-09-23 00:03:30,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-23 00:03:30,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure a364ef265fa51b1a230d745c9b2c41c6, server=jenkins-hbase4.apache.org,42773,1695427312328 in 168 msec 2023-09-23 00:03:30,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=adb3dc4192a8d4057d8c0b1d7379f6f3, UNASSIGN in 177 msec 2023-09-23 00:03:30,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-23 00:03:30,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a364ef265fa51b1a230d745c9b2c41c6, UNASSIGN in 177 msec 2023-09-23 00:03:30,644 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427410643"}]},"ts":"1695427410643"} 2023-09-23 00:03:30,645 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 00:03:30,648 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-23 00:03:30,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 195 msec 2023-09-23 00:03:30,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 00:03:30,759 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-23 00:03:30,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,763 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,764 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,765 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,768 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:30,768 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:30,770 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,770 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,770 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,770 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,770 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/recovered.edits] 2023-09-23 00:03:30,770 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/recovered.edits] 2023-09-23 00:03:30,770 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 00:03:30,770 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 00:03:30,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 00:03:30,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,772 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:30,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 00:03:30,775 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf/ca52960eccd445cab955a25d4f385784 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/cf/ca52960eccd445cab955a25d4f385784 2023-09-23 00:03:30,775 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf/497977c856fe422480ae4121e323aa69 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/cf/497977c856fe422480ae4121e323aa69 2023-09-23 00:03:30,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3/recovered.edits/9.seqid 2023-09-23 00:03:30,779 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6/recovered.edits/9.seqid 2023-09-23 00:03:30,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/adb3dc4192a8d4057d8c0b1d7379f6f3 2023-09-23 00:03:30,780 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testEmptyExportFileSystemState/a364ef265fa51b1a230d745c9b2c41c6 2023-09-23 00:03:30,780 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 00:03:30,780 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 00:03:30,781 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-23 00:03:30,784 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309233267f64ae16843bc907e71a1b9f937d0 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309233267f64ae16843bc907e71a1b9f937d0 2023-09-23 00:03:30,785 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309236127139b01d54c9b8a496bfc1d8c991d to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309236127139b01d54c9b8a496bfc1d8c991d 2023-09-23 00:03:30,785 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 00:03:30,787 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,789 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-23 00:03:30,791 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-23 00:03:30,792 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,792 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-23 00:03:30,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427410792"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:30,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427410792"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:30,794 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 00:03:30,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => adb3dc4192a8d4057d8c0b1d7379f6f3, NAME => 'testtb-testEmptyExportFileSystemState,,1695427399437.adb3dc4192a8d4057d8c0b1d7379f6f3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a364ef265fa51b1a230d745c9b2c41c6, NAME => 'testtb-testEmptyExportFileSystemState,1,1695427399437.a364ef265fa51b1a230d745c9b2c41c6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 00:03:30,794 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-23 00:03:30,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427410794"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:30,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-23 00:03:30,798 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 00:03:30,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-09-23 00:03:30,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 00:03:30,875 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-23 00:03:30,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-23 00:03:30,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:30,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-23 00:03:30,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-23 00:03:30,910 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 759) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:40311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:60986 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:48876 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:33717 from appattempt_1695427318695_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1287761086_1 at /127.0.0.1:60916 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2086093069_17 at /127.0.0.1:42346 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4608 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:45041 from appattempt_1695427318695_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=923 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 166), ProcessCount=171 (was 171), AvailableMemoryMB=1165 (was 1227) 2023-09-23 00:03:30,910 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 00:03:30,929 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=171, AvailableMemoryMB=1164 2023-09-23 00:03:30,930 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 00:03:30,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 00:03:30,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:30,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 00:03:30,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-23 00:03:30,935 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 00:03:30,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 00:03:30,937 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:30,937 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:30,938 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 empty. 2023-09-23 00:03:30,938 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 empty. 2023-09-23 00:03:30,938 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:30,938 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:30,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 00:03:30,953 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-23 00:03:30,954 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => f7d6b232935b0ee06606dc8b5ae63968, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:30,955 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a6062c716a4a5885c9df4ed93046be84, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp 2023-09-23 00:03:30,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:30,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing f7d6b232935b0ee06606dc8b5ae63968, disabling compactions & flushes 2023-09-23 00:03:30,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:30,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:30,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. after waiting 0 ms 2023-09-23 00:03:30,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:30,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:30,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for f7d6b232935b0ee06606dc8b5ae63968: 2023-09-23 00:03:31,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 00:03:31,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 00:03:31,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:31,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a6062c716a4a5885c9df4ed93046be84, disabling compactions & flushes 2023-09-23 00:03:31,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. after waiting 0 ms 2023-09-23 00:03:31,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a6062c716a4a5885c9df4ed93046be84: 2023-09-23 00:03:31,375 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 00:03:31,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427411376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427411376"}]},"ts":"1695427411376"} 2023-09-23 00:03:31,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427411376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427411376"}]},"ts":"1695427411376"} 2023-09-23 00:03:31,378 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 00:03:31,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 00:03:31,379 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427411379"}]},"ts":"1695427411379"} 2023-09-23 00:03:31,380 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-23 00:03:31,384 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 00:03:31,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 00:03:31,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 00:03:31,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 00:03:31,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 00:03:31,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, ASSIGN}] 2023-09-23 00:03:31,388 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, ASSIGN 2023-09-23 00:03:31,388 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, ASSIGN 2023-09-23 00:03:31,389 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44515,1695427312235; forceNewPlan=false, retain=false 2023-09-23 00:03:31,389 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37611,1695427312292; forceNewPlan=false, retain=false 2023-09-23 00:03:31,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 00:03:31,539 INFO [jenkins-hbase4:44537] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 00:03:31,542 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f7d6b232935b0ee06606dc8b5ae63968, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:31,542 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a6062c716a4a5885c9df4ed93046be84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:31,542 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427411542"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427411542"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427411542"}]},"ts":"1695427411542"} 2023-09-23 00:03:31,542 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427411542"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427411542"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427411542"}]},"ts":"1695427411542"} 2023-09-23 00:03:31,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure f7d6b232935b0ee06606dc8b5ae63968, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:03:31,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure a6062c716a4a5885c9df4ed93046be84, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:31,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:31,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7d6b232935b0ee06606dc8b5ae63968, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a6062c716a4a5885c9df4ed93046be84, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. service=AccessControlService 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. service=AccessControlService 2023-09-23 00:03:31,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,700 INFO [StoreOpener-f7d6b232935b0ee06606dc8b5ae63968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,701 INFO [StoreOpener-a6062c716a4a5885c9df4ed93046be84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,702 DEBUG [StoreOpener-f7d6b232935b0ee06606dc8b5ae63968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf 2023-09-23 00:03:31,702 DEBUG [StoreOpener-f7d6b232935b0ee06606dc8b5ae63968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf 2023-09-23 00:03:31,702 DEBUG [StoreOpener-a6062c716a4a5885c9df4ed93046be84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf 2023-09-23 00:03:31,702 DEBUG [StoreOpener-a6062c716a4a5885c9df4ed93046be84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf 2023-09-23 00:03:31,702 INFO [StoreOpener-f7d6b232935b0ee06606dc8b5ae63968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7d6b232935b0ee06606dc8b5ae63968 columnFamilyName cf 2023-09-23 00:03:31,703 INFO [StoreOpener-a6062c716a4a5885c9df4ed93046be84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6062c716a4a5885c9df4ed93046be84 columnFamilyName cf 2023-09-23 00:03:31,704 INFO [StoreOpener-a6062c716a4a5885c9df4ed93046be84-1] regionserver.HStore(310): Store=a6062c716a4a5885c9df4ed93046be84/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:31,704 INFO [StoreOpener-f7d6b232935b0ee06606dc8b5ae63968-1] regionserver.HStore(310): Store=f7d6b232935b0ee06606dc8b5ae63968/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 00:03:31,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:31,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:31,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 00:03:31,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a6062c716a4a5885c9df4ed93046be84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63892530, jitterRate=-0.04792711138725281}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a6062c716a4a5885c9df4ed93046be84: 2023-09-23 00:03:31,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7d6b232935b0ee06606dc8b5ae63968; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61836943, jitterRate=-0.07855774462223053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 00:03:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7d6b232935b0ee06606dc8b5ae63968: 2023-09-23 00:03:31,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84., pid=109, masterSystemTime=1695427411695 2023-09-23 00:03:31,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968., pid=108, masterSystemTime=1695427411694 2023-09-23 00:03:31,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:31,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a6062c716a4a5885c9df4ed93046be84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:31,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:31,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:31,713 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427411712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427411712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427411712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427411712"}]},"ts":"1695427411712"} 2023-09-23 00:03:31,713 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f7d6b232935b0ee06606dc8b5ae63968, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:31,713 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427411713"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695427411713"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695427411713"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695427411713"}]},"ts":"1695427411713"} 2023-09-23 00:03:31,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-23 00:03:31,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure a6062c716a4a5885c9df4ed93046be84, server=jenkins-hbase4.apache.org,37611,1695427312292 in 170 msec 2023-09-23 00:03:31,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-23 00:03:31,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure f7d6b232935b0ee06606dc8b5ae63968, server=jenkins-hbase4.apache.org,44515,1695427312235 in 172 msec 2023-09-23 00:03:31,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, ASSIGN in 331 msec 2023-09-23 00:03:31,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-23 00:03:31,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, ASSIGN in 332 msec 2023-09-23 00:03:31,719 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 00:03:31,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427411719"}]},"ts":"1695427411719"} 2023-09-23 00:03:31,720 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-23 00:03:31,722 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 00:03:31,722 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-23 00:03:31,724 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 00:03:31,725 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:31,725 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:31,725 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:31,725 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:31,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:31,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:31,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:31,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 00:03:31,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 796 msec 2023-09-23 00:03:32,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 00:03:32,040 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-23 00:03:32,042 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,042 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:32,043 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:03:32,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 00:03:32,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427412053 (current time:1695427412053). 2023-09-23 00:03:32,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:32,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x54855dac to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:32,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3447fef9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:32,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:32,063 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54855dac to 127.0.0.1:52502 2023-09-23 00:03:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:32,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x5c133344 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:32,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22856d57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:32,071 DEBUG [hconnection-0x29beffc8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:32,072 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:32,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c133344 to 127.0.0.1:52502 2023-09-23 00:03:32,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 00:03:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 00:03:32,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 00:03:32,079 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 00:03:32,079 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695428012079 2023-09-23 00:03:32,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 00:03:32,081 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:32,081 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:32,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 00:03:32,082 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 00:03:32,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-23 00:03:32,083 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 00:03:32,084 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695428012084 2023-09-23 00:03:32,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,092 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 00:03:32,092 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,093 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 00:03:32,093 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 00:03:32,093 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,093 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,096 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,096 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,096 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,096 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,096 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,096 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,097 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 00:03:32,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 00:03:32,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 00:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 00:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,099 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,099 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 00:03:32,099 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 00:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 00:03:32,107 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,108 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,108 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6b9bff[Count = 1] remaining members to acquire global barrier 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 00:03:32,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6b9bff[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:32,112 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 00:03:32,112 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 00:03:32,113 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,113 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:32,114 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 00:03:32,114 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,114 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:32,114 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. started... 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:32,114 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:32,114 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7d6b232935b0ee06606dc8b5ae63968: 2023-09-23 00:03:32,114 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. started... 2023-09-23 00:03:32,114 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,115 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:32,115 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6062c716a4a5885c9df4ed93046be84: 2023-09-23 00:03:32,115 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:03:32,115 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,115 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:32,115 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 00:03:32,116 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 00:03:32,116 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,116 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 00:03:32,124 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. completed. 2023-09-23 00:03:32,124 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:32,124 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:32,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:32,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 00:03:32,125 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:32,126 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. completed. 2023-09-23 00:03:32,126 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 00:03:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:32,127 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 00:03:32,127 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,127 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,127 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 00:03:32,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,130 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,130 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 00:03:32,130 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,130 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 00:03:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44515,1695427312235': 2023-09-23 00:03:32,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 00:03:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:32,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 00:03:32,137 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 00:03:32,137 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:32,138 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:32,138 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,138 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:32,140 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,140 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,140 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,140 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,140 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,141 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,140 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,141 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,141 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,142 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,144 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,144 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,144 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,147 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,149 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,147 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,149 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:03:32,150 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,150 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,150 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,150 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,150 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,150 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 00:03:32,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 00:03:32,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,175 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695427412080Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695427412158 (+78 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695427412158Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695427412158Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695427412161 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695427412167 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695427412174 (+7 ms) 2023-09-23 00:03:32,177 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 00:03:32,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 97 msec 2023-09-23 00:03:32,181 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:32,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 00:03:32,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:32,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44515] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:03:32,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37611] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 00:03:32,186 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,186 DEBUG [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:32,187 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 00:03:32,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 00:03:32,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695427412194 (current time:1695427412194). 2023-09-23 00:03:32,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 00:03:32,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x2457ae8a to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ac94577, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:32,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:32,206 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:32,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2457ae8a to 127.0.0.1:52502 2023-09-23 00:03:32,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:32,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(139): Connect 0x5b1e7471 to 127.0.0.1:52502 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 00:03:32,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4224b266, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 00:03:32,214 DEBUG [hconnection-0x72f6b5a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 00:03:32,217 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 00:03:32,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b1e7471 to 127.0.0.1:52502 2023-09-23 00:03:32,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:03:32,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 00:03:32,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 00:03:32,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 00:03:32,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 00:03:32,225 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 00:03:32,226 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695428012226 2023-09-23 00:03:32,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 00:03:32,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,227 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 00:03:32,227 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 00:03:32,228 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 00:03:32,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 00:03:32,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-23 00:03:32,230 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 00:03:32,230 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695428012230 2023-09-23 00:03:32,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,241 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 00:03:32,241 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,242 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 00:03:32,242 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 00:03:32,243 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,243 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,245 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,245 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,245 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,245 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,246 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,246 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,246 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,246 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 00:03:32,247 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 00:03:32,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,247 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,247 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,249 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 00:03:32,249 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 00:03:32,250 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 00:03:32,250 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 00:03:32,248 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 00:03:32,250 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 00:03:32,250 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 00:03:32,250 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 00:03:32,251 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 00:03:32,251 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 00:03:32,251 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1695427312328' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 00:03:32,252 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,253 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,253 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,253 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,253 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,253 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:32,253 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 00:03:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44515,1695427312235' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@427b6859[Count = 1] remaining members to acquire global barrier 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37611,1695427312292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 00:03:32,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@427b6859[Count = 0] remaining members to acquire global barrier 2023-09-23 00:03:32,257 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 00:03:32,257 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 00:03:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,262 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 00:03:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:32,262 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:32,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,263 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. started... 2023-09-23 00:03:32,263 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,263 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 00:03:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 00:03:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,263 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42773,1695427312328' in zk 2023-09-23 00:03:32,263 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f7d6b232935b0ee06606dc8b5ae63968 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-23 00:03:32,263 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 00:03:32,263 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 00:03:32,263 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 00:03:32,263 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:32,263 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. started... 2023-09-23 00:03:32,263 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a6062c716a4a5885c9df4ed93046be84 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-23 00:03:32,264 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 00:03:32,264 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,265 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1695427312328' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 00:03:32,291 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923a7c88c16dc5146b381553906152962fa to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923a7c88c16dc5146b381553906152962fa 2023-09-23 00:03:32,292 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923000b2164a6ab444fb1bc319495b5aea4 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923000b2164a6ab444fb1bc319495b5aea4 2023-09-23 00:03:32,308 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/.tmp/cf/431c88db6c3e41b186688462e66b14c5 2023-09-23 00:03:32,308 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/.tmp/cf/f0f2ff8b2bd54599b574029fc1628738 2023-09-23 00:03:32,313 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/.tmp/cf/431c88db6c3e41b186688462e66b14c5 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf/431c88db6c3e41b186688462e66b14c5 2023-09-23 00:03:32,313 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/.tmp/cf/f0f2ff8b2bd54599b574029fc1628738 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf/f0f2ff8b2bd54599b574029fc1628738 2023-09-23 00:03:32,318 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf/f0f2ff8b2bd54599b574029fc1628738, entries=47, sequenceid=6, filesize=13.3 K 2023-09-23 00:03:32,318 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf/431c88db6c3e41b186688462e66b14c5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-23 00:03:32,319 INFO [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f7d6b232935b0ee06606dc8b5ae63968 in 56ms, sequenceid=6, compaction requested=false 2023-09-23 00:03:32,319 INFO [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a6062c716a4a5885c9df4ed93046be84 in 56ms, sequenceid=6, compaction requested=false 2023-09-23 00:03:32,319 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 00:03:32,319 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6062c716a4a5885c9df4ed93046be84: 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7d6b232935b0ee06606dc8b5ae63968: 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf/f0f2ff8b2bd54599b574029fc1628738] hfiles 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf/f0f2ff8b2bd54599b574029fc1628738 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,322 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 00:03:32,323 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf/431c88db6c3e41b186688462e66b14c5] hfiles 2023-09-23 00:03:32,323 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf/431c88db6c3e41b186688462e66b14c5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,327 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 00:03:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 00:03:32,328 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 00:03:32,341 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. completed. 2023-09-23 00:03:32,341 DEBUG [rs(jenkins-hbase4.apache.org,37611,1695427312292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:32,341 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:32,341 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:32,341 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,341 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 00:03:32,341 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37611,1695427312292' in zk 2023-09-23 00:03:32,343 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. completed. 2023-09-23 00:03:32,343 DEBUG [rs(jenkins-hbase4.apache.org,44515,1695427312235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:32,343 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,343 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 00:03:32,343 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 00:03:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,343 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 00:03:32,344 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,344 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,344 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 00:03:32,344 DEBUG [member: 'jenkins-hbase4.apache.org,37611,1695427312292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 00:03:32,344 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44515,1695427312235' in zk 2023-09-23 00:03:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,347 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,347 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 00:03:32,348 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,348 DEBUG [member: 'jenkins-hbase4.apache.org,44515,1695427312235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 00:03:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37611,1695427312292': 2023-09-23 00:03:32,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37611,1695427312292' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 00:03:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44515,1695427312235': 2023-09-23 00:03:32,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44515,1695427312235' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 00:03:32,355 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 00:03:32,355 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 00:03:32,355 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 00:03:32,355 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,355 INFO [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 00:03:32,357 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,357 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,357 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 00:03:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 00:03:32,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,357 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,357 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 00:03:32,358 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,358 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,359 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 00:03:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,360 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 00:03:32,361 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,361 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,364 DEBUG [(jenkins-hbase4.apache.org,44537,1695427310899)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 00:03:32,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 00:03:32,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 00:03:32,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 00:03:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:03:32,366 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,367 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:32,367 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:32,367 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,367 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 00:03:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 00:03:32,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923a7c88c16dc5146b381553906152962fa, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923000b2164a6ab444fb1bc319495b5aea4] mob files 2023-09-23 00:03:32,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923a7c88c16dc5146b381553906152962fa 2023-09-23 00:03:32,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923000b2164a6ab444fb1bc319495b5aea4 2023-09-23 00:03:32,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 00:03:32,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,393 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695427412226Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695427412375 (+149 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695427412375Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695427412375Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695427412378 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695427412386 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695427412392 (+6 ms) 2023-09-23 00:03:32,395 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 00:03:32,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 168 msec 2023-09-23 00:03:32,529 DEBUG [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 00:03:32,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 00:03:32,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 00:03:32,530 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530 2023-09-23 00:03:32,530 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33037, tgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530, rawTgtDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530, srcFsUri=hdfs://localhost:33037, srcDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:03:32,552 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5 2023-09-23 00:03:32,552 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-253046047_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,552 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33037, inputRoot=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5, snapshotDir=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-23 00:03:32,560 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:32,575 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:32,575 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:32,576 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:32,576 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,449 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-7659227678194830358.jar 2023-09-23 00:03:33,449 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,450 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,516 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/hadoop-2775085989963782975.jar 2023-09-23 00:03:33,517 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,517 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 00:03:33,519 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 00:03:33,519 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 00:03:33,520 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 00:03:33,520 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 00:03:33,520 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 00:03:33,521 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 00:03:33,521 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 00:03:33,521 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 00:03:33,522 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 00:03:33,522 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 00:03:33,523 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:33,523 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:33,523 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:33,524 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:33,524 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 00:03:33,524 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:33,525 DEBUG [Listener at jenkins-hbase4.apache.org/40639] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 00:03:33,857 WARN [Listener at jenkins-hbase4.apache.org/40639] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 00:03:33,859 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-23 00:03:33,861 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-23 00:03:34,912 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:03:34,912 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 00:03:34,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0006_000001 (auth:SIMPLE) 2023-09-23 00:03:35,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0007_000001 (auth:SIMPLE) 2023-09-23 00:03:36,218 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:03:38,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0007_000001 (auth:SIMPLE) 2023-09-23 00:03:41,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0007_000001 (auth:SIMPLE) 2023-09-23 00:03:44,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0007_000001 (auth:SIMPLE) 2023-09-23 00:03:46,027 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 00:03:46,028 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 00:03:46,039 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,039 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 00:03:46,040 INFO [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 00:03:46,040 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,040 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 00:03:46,041 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 00:03:46,041 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-649650997_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,041 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 00:03:46,041 DEBUG [Listener at jenkins-hbase4.apache.org/40639] snapshot.TestExportSnapshot(367): hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/export-test/export-1695427412530/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 00:03:46,047 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 00:03:46,051 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427426051"}]},"ts":"1695427426051"} 2023-09-23 00:03:46,053 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-23 00:03:46,054 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-23 00:03:46,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, UNASSIGN}] 2023-09-23 00:03:46,057 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, UNASSIGN 2023-09-23 00:03:46,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, UNASSIGN 2023-09-23 00:03:46,058 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a6062c716a4a5885c9df4ed93046be84, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:03:46,058 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427426058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427426058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427426058"}]},"ts":"1695427426058"} 2023-09-23 00:03:46,058 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f7d6b232935b0ee06606dc8b5ae63968, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:03:46,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427426058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695427426058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695427426058"}]},"ts":"1695427426058"} 2023-09-23 00:03:46,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure a6062c716a4a5885c9df4ed93046be84, server=jenkins-hbase4.apache.org,37611,1695427312292}] 2023-09-23 00:03:46,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure f7d6b232935b0ee06606dc8b5ae63968, server=jenkins-hbase4.apache.org,44515,1695427312235}] 2023-09-23 00:03:46,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 00:03:46,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:46,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7d6b232935b0ee06606dc8b5ae63968, disabling compactions & flushes 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a6062c716a4a5885c9df4ed93046be84, disabling compactions & flushes 2023-09-23 00:03:46,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:46,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. after waiting 0 ms 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. after waiting 0 ms 2023-09-23 00:03:46,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:46,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:46,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:03:46,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:46,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:03:46,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84. 2023-09-23 00:03:46,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968. 2023-09-23 00:03:46,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7d6b232935b0ee06606dc8b5ae63968: 2023-09-23 00:03:46,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a6062c716a4a5885c9df4ed93046be84: 2023-09-23 00:03:46,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:46,229 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a6062c716a4a5885c9df4ed93046be84, regionState=CLOSED 2023-09-23 00:03:46,229 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427426229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427426229"}]},"ts":"1695427426229"} 2023-09-23 00:03:46,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:46,229 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f7d6b232935b0ee06606dc8b5ae63968, regionState=CLOSED 2023-09-23 00:03:46,229 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695427426229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695427426229"}]},"ts":"1695427426229"} 2023-09-23 00:03:46,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-23 00:03:46,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure a6062c716a4a5885c9df4ed93046be84, server=jenkins-hbase4.apache.org,37611,1695427312292 in 171 msec 2023-09-23 00:03:46,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-23 00:03:46,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure f7d6b232935b0ee06606dc8b5ae63968, server=jenkins-hbase4.apache.org,44515,1695427312235 in 171 msec 2023-09-23 00:03:46,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6062c716a4a5885c9df4ed93046be84, UNASSIGN in 176 msec 2023-09-23 00:03:46,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-23 00:03:46,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f7d6b232935b0ee06606dc8b5ae63968, UNASSIGN in 177 msec 2023-09-23 00:03:46,235 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695427426234"}]},"ts":"1695427426234"} 2023-09-23 00:03:46,236 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-23 00:03:46,237 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-23 00:03:46,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-09-23 00:03:46,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 00:03:46,353 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-23 00:03:46,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,357 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,358 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,359 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,361 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:46,361 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:46,362 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,362 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,362 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,362 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 00:03:46,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 00:03:46,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 00:03:46,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 00:03:46,363 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/recovered.edits] 2023-09-23 00:03:46,363 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf, FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/recovered.edits] 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:46,364 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 00:03:46,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 00:03:46,367 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf/f0f2ff8b2bd54599b574029fc1628738 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/cf/f0f2ff8b2bd54599b574029fc1628738 2023-09-23 00:03:46,367 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf/431c88db6c3e41b186688462e66b14c5 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/cf/431c88db6c3e41b186688462e66b14c5 2023-09-23 00:03:46,371 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84/recovered.edits/9.seqid 2023-09-23 00:03:46,371 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/recovered.edits/9.seqid to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968/recovered.edits/9.seqid 2023-09-23 00:03:46,371 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6062c716a4a5885c9df4ed93046be84 2023-09-23 00:03:46,371 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f7d6b232935b0ee06606dc8b5ae63968 2023-09-23 00:03:46,372 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 00:03:46,372 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 00:03:46,373 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-23 00:03:46,376 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923a7c88c16dc5146b381553906152962fa to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923a7c88c16dc5146b381553906152962fa 2023-09-23 00:03:46,377 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923000b2164a6ab444fb1bc319495b5aea4 to hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923000b2164a6ab444fb1bc319495b5aea4 2023-09-23 00:03:46,378 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 00:03:46,379 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,382 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-23 00:03:46,383 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-23 00:03:46,384 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,384 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-23 00:03:46,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427426384"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:46,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695427426384"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:46,386 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 00:03:46,386 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f7d6b232935b0ee06606dc8b5ae63968, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695427410931.f7d6b232935b0ee06606dc8b5ae63968.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a6062c716a4a5885c9df4ed93046be84, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695427410931.a6062c716a4a5885c9df4ed93046be84.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 00:03:46,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-23 00:03:46,386 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695427426386"}]},"ts":"9223372036854775807"} 2023-09-23 00:03:46,387 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-23 00:03:46,389 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-23 00:03:46,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 00:03:46,466 INFO [Listener at jenkins-hbase4.apache.org/40639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-23 00:03:46,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 00:03:46,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 00:03:46,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44537] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 00:03:46,502 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1451563294_1 at /127.0.0.1:57032 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1451563294_1 at /127.0.0.1:53292 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:42505 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:38936 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5210 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:51970 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-649650997_17 at /127.0.0.1:42020 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56cfdced-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=132 (was 152), ProcessCount=169 (was 171), AvailableMemoryMB=1060 (was 1164) 2023-09-23 00:03:46,502 WARN [Listener at jenkins-hbase4.apache.org/40639] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 00:03:46,502 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-23 00:03:46,512 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 00:03:50,222 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695427318695_0007_000001 (auth:SIMPLE) 2023-09-23 00:03:51,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 00:04:00,634 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 00:04:14,752 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 00:04:14,752 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 00:04:14,860 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-23 00:04:14,869 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-23 00:04:14,871 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 00:04:14,881 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 00:04:14,984 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 00:04:14,985 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-23 00:04:14,985 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-23 00:04:14,985 INFO [Listener at jenkins-hbase4.apache.org/40639] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-23 00:04:14,985 DEBUG [Listener at jenkins-hbase4.apache.org/40639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:52502 2023-09-23 00:04:14,985 DEBUG [Listener at jenkins-hbase4.apache.org/40639] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:14,985 DEBUG [Listener at jenkins-hbase4.apache.org/40639] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-23 00:04:14,985 DEBUG [Listener at jenkins-hbase4.apache.org/40639] util.JVMClusterUtil(257): Found active master hash=806650342, stopped=false 2023-09-23 00:04:14,986 DEBUG [Listener at jenkins-hbase4.apache.org/40639] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:14,986 DEBUG [Listener at jenkins-hbase4.apache.org/40639] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 00:04:14,986 INFO [Listener at jenkins-hbase4.apache.org/40639] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:04:14,987 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 00:04:14,987 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 00:04:14,987 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 00:04:14,987 INFO [Listener at jenkins-hbase4.apache.org/40639] procedure2.ProcedureExecutor(628): Stopping 2023-09-23 00:04:14,987 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:04:14,987 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 00:04:14,987 DEBUG [Listener at jenkins-hbase4.apache.org/40639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18af9798 to 127.0.0.1:52502 2023-09-23 00:04:14,988 DEBUG [Listener at jenkins-hbase4.apache.org/40639] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:14,988 INFO [Listener at jenkins-hbase4.apache.org/40639] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44515,1695427312235' ***** 2023-09-23 00:04:14,988 DEBUG [Listener at jenkins-hbase4.apache.org/40639] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:14,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:04:14,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:04:14,988 INFO [Listener at jenkins-hbase4.apache.org/40639] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 00:04:14,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:04:14,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 00:04:14,988 INFO [Listener at jenkins-hbase4.apache.org/40639] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37611,1695427312292' ***** 2023-09-23 00:04:14,989 INFO [RS:0;jenkins-hbase4:44515] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 00:04:14,989 DEBUG [Listener at jenkins-hbase4.apache.org/40639] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:14,989 INFO [Listener at jenkins-hbase4.apache.org/40639] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 00:04:14,989 INFO [RS:0;jenkins-hbase4:44515] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 00:04:14,989 INFO [Listener at jenkins-hbase4.apache.org/40639] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42773,1695427312328' ***** 2023-09-23 00:04:14,989 INFO [RS:1;jenkins-hbase4:37611] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 00:04:14,989 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 00:04:14,989 INFO [RS:1;jenkins-hbase4:37611] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 00:04:14,989 DEBUG [Listener at jenkins-hbase4.apache.org/40639] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:14,989 INFO [RS:0;jenkins-hbase4:44515] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 00:04:14,989 INFO [Listener at jenkins-hbase4.apache.org/40639] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 00:04:14,989 INFO [RS:1;jenkins-hbase4:37611] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 00:04:14,989 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 00:04:14,989 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:04:14,989 INFO [RS:2;jenkins-hbase4:42773] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 00:04:14,990 DEBUG [RS:1;jenkins-hbase4:37611] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d91f308 to 127.0.0.1:52502 2023-09-23 00:04:14,990 INFO [RS:2;jenkins-hbase4:42773] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 00:04:14,990 DEBUG [RS:1;jenkins-hbase4:37611] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:14,990 INFO [RS:2;jenkins-hbase4:42773] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 00:04:14,990 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 00:04:14,991 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37611,1695427312292; all regions closed. 2023-09-23 00:04:14,991 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(3305): Received CLOSE for 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:04:14,989 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(3305): Received CLOSE for 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:04:14,991 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:04:14,991 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:04:14,991 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2079b8bc to 127.0.0.1:52502 2023-09-23 00:04:14,991 DEBUG [RS:0;jenkins-hbase4:44515] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02ea2e4b to 127.0.0.1:52502 2023-09-23 00:04:14,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 54ceb846fedecd81fc9168579357ca77, disabling compactions & flushes 2023-09-23 00:04:14,992 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:14,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:04:14,992 DEBUG [RS:0;jenkins-hbase4:44515] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:14,994 INFO [RS:2;jenkins-hbase4:42773] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 00:04:14,995 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 00:04:14,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2ec7f95e24c47cf2a83f9488644c522b, disabling compactions & flushes 2023-09-23 00:04:14,995 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1478): Online Regions={54ceb846fedecd81fc9168579357ca77=hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77.} 2023-09-23 00:04:14,995 INFO [RS:2;jenkins-hbase4:42773] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 00:04:14,995 INFO [RS:2;jenkins-hbase4:42773] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 00:04:14,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:04:14,995 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-23 00:04:14,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. after waiting 0 ms 2023-09-23 00:04:14,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:04:14,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:04:14,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:04:14,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 54ceb846fedecd81fc9168579357ca77 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-23 00:04:14,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. after waiting 0 ms 2023-09-23 00:04:14,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:04:14,995 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-23 00:04:14,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2ec7f95e24c47cf2a83f9488644c522b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-23 00:04:14,996 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1478): Online Regions={2ec7f95e24c47cf2a83f9488644c522b=hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b., 1588230740=hbase:meta,,1.1588230740} 2023-09-23 00:04:14,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 00:04:14,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 00:04:14,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 00:04:14,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 00:04:14,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 00:04:14,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-23 00:04:14,996 DEBUG [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1504): Waiting on 54ceb846fedecd81fc9168579357ca77 2023-09-23 00:04:14,996 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1504): Waiting on 1588230740, 2ec7f95e24c47cf2a83f9488644c522b 2023-09-23 00:04:15,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/.tmp/l/59884ea525e44ce3ad92f4b1432795d8 2023-09-23 00:04:15,021 DEBUG [RS:1;jenkins-hbase4:37611] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs 2023-09-23 00:04:15,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/.tmp/info/b0e244a3f1844ab38175a57d6ebb47b2 2023-09-23 00:04:15,021 INFO [RS:1;jenkins-hbase4:37611] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37611%2C1695427312292:(num 1695427313971) 2023-09-23 00:04:15,022 DEBUG [RS:1;jenkins-hbase4:37611] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:15,022 INFO [RS:1;jenkins-hbase4:37611] regionserver.LeaseManager(133): Closed leases 2023-09-23 00:04:15,022 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/.tmp/info/e8446d0da2214975bf1a60262625e192 2023-09-23 00:04:15,023 INFO [RS:1;jenkins-hbase4:37611] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-23 00:04:15,023 INFO [RS:1;jenkins-hbase4:37611] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 00:04:15,023 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 00:04:15,023 INFO [RS:1;jenkins-hbase4:37611] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 00:04:15,023 INFO [RS:1;jenkins-hbase4:37611] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 00:04:15,025 INFO [RS:1;jenkins-hbase4:37611] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37611 2023-09-23 00:04:15,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59884ea525e44ce3ad92f4b1432795d8 2023-09-23 00:04:15,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/.tmp/l/59884ea525e44ce3ad92f4b1432795d8 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/l/59884ea525e44ce3ad92f4b1432795d8 2023-09-23 00:04:15,031 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:04:15,031 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:04:15,032 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:04:15,032 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37611,1695427312292 2023-09-23 00:04:15,032 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:04:15,032 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:04:15,032 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:04:15,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/.tmp/info/b0e244a3f1844ab38175a57d6ebb47b2 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/info/b0e244a3f1844ab38175a57d6ebb47b2 2023-09-23 00:04:15,033 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8446d0da2214975bf1a60262625e192 2023-09-23 00:04:15,034 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37611,1695427312292] 2023-09-23 00:04:15,034 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37611,1695427312292; numProcessing=1 2023-09-23 00:04:15,037 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37611,1695427312292 already deleted, retry=false 2023-09-23 00:04:15,037 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37611,1695427312292 expired; onlineServers=2 2023-09-23 00:04:15,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/info/b0e244a3f1844ab38175a57d6ebb47b2, entries=2, sequenceid=6, filesize=4.8 K 2023-09-23 00:04:15,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 54ceb846fedecd81fc9168579357ca77 in 44ms, sequenceid=6, compaction requested=false 2023-09-23 00:04:15,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59884ea525e44ce3ad92f4b1432795d8 2023-09-23 00:04:15,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/l/59884ea525e44ce3ad92f4b1432795d8, entries=7, sequenceid=18, filesize=5.2 K 2023-09-23 00:04:15,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2ec7f95e24c47cf2a83f9488644c522b in 46ms, sequenceid=18, compaction requested=false 2023-09-23 00:04:15,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/acl/2ec7f95e24c47cf2a83f9488644c522b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-23 00:04:15,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/namespace/54ceb846fedecd81fc9168579357ca77/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 00:04:15,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:15,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:15,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:04:15,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2ec7f95e24c47cf2a83f9488644c522b: 2023-09-23 00:04:15,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:04:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 54ceb846fedecd81fc9168579357ca77: 2023-09-23 00:04:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695427315153.2ec7f95e24c47cf2a83f9488644c522b. 2023-09-23 00:04:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695427314413.54ceb846fedecd81fc9168579357ca77. 2023-09-23 00:04:15,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/.tmp/rep_barrier/eb3fcc2001dd4eb3ae80e775e307bae6 2023-09-23 00:04:15,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb3fcc2001dd4eb3ae80e775e307bae6 2023-09-23 00:04:15,071 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 00:04:15,071 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 00:04:15,071 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 00:04:15,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/.tmp/table/3c0788608f2443e4a00e799b9ce607a3 2023-09-23 00:04:15,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c0788608f2443e4a00e799b9ce607a3 2023-09-23 00:04:15,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/.tmp/info/e8446d0da2214975bf1a60262625e192 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/info/e8446d0da2214975bf1a60262625e192 2023-09-23 00:04:15,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8446d0da2214975bf1a60262625e192 2023-09-23 00:04:15,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/info/e8446d0da2214975bf1a60262625e192, entries=48, sequenceid=131, filesize=10.3 K 2023-09-23 00:04:15,082 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/.tmp/rep_barrier/eb3fcc2001dd4eb3ae80e775e307bae6 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/rep_barrier/eb3fcc2001dd4eb3ae80e775e307bae6 2023-09-23 00:04:15,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb3fcc2001dd4eb3ae80e775e307bae6 2023-09-23 00:04:15,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/rep_barrier/eb3fcc2001dd4eb3ae80e775e307bae6, entries=13, sequenceid=131, filesize=6.4 K 2023-09-23 00:04:15,087 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/.tmp/table/3c0788608f2443e4a00e799b9ce607a3 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/table/3c0788608f2443e4a00e799b9ce607a3 2023-09-23 00:04:15,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c0788608f2443e4a00e799b9ce607a3 2023-09-23 00:04:15,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/table/3c0788608f2443e4a00e799b9ce607a3, entries=24, sequenceid=131, filesize=6.9 K 2023-09-23 00:04:15,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 95ms, sequenceid=131, compaction requested=false 2023-09-23 00:04:15,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-23 00:04:15,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 00:04:15,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 00:04:15,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 00:04:15,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 00:04:15,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-23 00:04:15,134 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,134 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:37611-0x100d616e9310002, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,134 INFO [RS:1;jenkins-hbase4:37611] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37611,1695427312292; zookeeper connection closed. 2023-09-23 00:04:15,134 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@79f57da7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@79f57da7 2023-09-23 00:04:15,197 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44515,1695427312235; all regions closed. 2023-09-23 00:04:15,197 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42773,1695427312328; all regions closed. 2023-09-23 00:04:15,203 DEBUG [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs 2023-09-23 00:04:15,203 DEBUG [RS:0;jenkins-hbase4:44515] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs 2023-09-23 00:04:15,203 INFO [RS:0;jenkins-hbase4:44515] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44515%2C1695427312235:(num 1695427313971) 2023-09-23 00:04:15,203 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42773%2C1695427312328.meta:.meta(num 1695427314106) 2023-09-23 00:04:15,204 DEBUG [RS:0;jenkins-hbase4:44515] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:15,204 INFO [RS:0;jenkins-hbase4:44515] regionserver.LeaseManager(133): Closed leases 2023-09-23 00:04:15,204 INFO [RS:0;jenkins-hbase4:44515] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-23 00:04:15,204 INFO [RS:0;jenkins-hbase4:44515] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 00:04:15,204 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 00:04:15,204 INFO [RS:0;jenkins-hbase4:44515] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 00:04:15,205 INFO [RS:0;jenkins-hbase4:44515] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 00:04:15,205 INFO [RS:0;jenkins-hbase4:44515] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44515 2023-09-23 00:04:15,207 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:04:15,207 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44515,1695427312235 2023-09-23 00:04:15,207 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:04:15,210 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44515,1695427312235] 2023-09-23 00:04:15,210 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44515,1695427312235; numProcessing=2 2023-09-23 00:04:15,211 DEBUG [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/oldWALs 2023-09-23 00:04:15,211 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42773%2C1695427312328:(num 1695427313970) 2023-09-23 00:04:15,211 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:15,211 INFO [RS:2;jenkins-hbase4:42773] regionserver.LeaseManager(133): Closed leases 2023-09-23 00:04:15,211 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-23 00:04:15,211 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 00:04:15,212 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44515,1695427312235 already deleted, retry=false 2023-09-23 00:04:15,212 INFO [RS:2;jenkins-hbase4:42773] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42773 2023-09-23 00:04:15,212 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44515,1695427312235 expired; onlineServers=1 2023-09-23 00:04:15,218 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 00:04:15,218 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42773,1695427312328 2023-09-23 00:04:15,219 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42773,1695427312328] 2023-09-23 00:04:15,219 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42773,1695427312328; numProcessing=3 2023-09-23 00:04:15,220 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42773,1695427312328 already deleted, retry=false 2023-09-23 00:04:15,220 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42773,1695427312328 expired; onlineServers=0 2023-09-23 00:04:15,220 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44537,1695427310899' ***** 2023-09-23 00:04:15,220 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-23 00:04:15,220 DEBUG [M:0;jenkins-hbase4:44537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71298bdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 00:04:15,220 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44537,1695427310899 2023-09-23 00:04:15,220 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44537,1695427310899; all regions closed. 2023-09-23 00:04:15,220 DEBUG [M:0;jenkins-hbase4:44537] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 00:04:15,220 DEBUG [M:0;jenkins-hbase4:44537] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-23 00:04:15,220 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-23 00:04:15,220 DEBUG [M:0;jenkins-hbase4:44537] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-23 00:04:15,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695427313587] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695427313587,5,FailOnTimeoutGroup] 2023-09-23 00:04:15,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695427313587] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695427313587,5,FailOnTimeoutGroup] 2023-09-23 00:04:15,220 INFO [M:0;jenkins-hbase4:44537] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-23 00:04:15,221 INFO [M:0;jenkins-hbase4:44537] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-23 00:04:15,221 INFO [M:0;jenkins-hbase4:44537] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-23 00:04:15,221 DEBUG [M:0;jenkins-hbase4:44537] master.HMaster(1512): Stopping service threads 2023-09-23 00:04:15,221 INFO [M:0;jenkins-hbase4:44537] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-23 00:04:15,221 ERROR [M:0;jenkins-hbase4:44537] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-23 00:04:15,221 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-23 00:04:15,221 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 00:04:15,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 00:04:15,222 INFO [M:0;jenkins-hbase4:44537] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-23 00:04:15,222 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-23 00:04:15,222 DEBUG [M:0;jenkins-hbase4:44537] zookeeper.ZKUtil(398): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-23 00:04:15,222 WARN [M:0;jenkins-hbase4:44537] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-23 00:04:15,222 INFO [M:0;jenkins-hbase4:44537] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-23 00:04:15,223 INFO [M:0;jenkins-hbase4:44537] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-23 00:04:15,223 DEBUG [M:0;jenkins-hbase4:44537] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 00:04:15,223 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:04:15,223 DEBUG [M:0;jenkins-hbase4:44537] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:04:15,223 DEBUG [M:0;jenkins-hbase4:44537] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 00:04:15,223 DEBUG [M:0;jenkins-hbase4:44537] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:04:15,224 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.93 KB heapSize=452.17 KB 2023-09-23 00:04:15,238 INFO [M:0;jenkins-hbase4:44537] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.93 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c6eb851b155419fb7ec14470774d828 2023-09-23 00:04:15,241 INFO [M:0;jenkins-hbase4:44537] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c6eb851b155419fb7ec14470774d828 2023-09-23 00:04:15,242 DEBUG [M:0;jenkins-hbase4:44537] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c6eb851b155419fb7ec14470774d828 as hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c6eb851b155419fb7ec14470774d828 2023-09-23 00:04:15,245 INFO [M:0;jenkins-hbase4:44537] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c6eb851b155419fb7ec14470774d828 2023-09-23 00:04:15,246 INFO [M:0;jenkins-hbase4:44537] regionserver.HStore(1080): Added hdfs://localhost:33037/user/jenkins/test-data/02262917-457f-92b2-dbd9-c5986bc6cdf5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c6eb851b155419fb7ec14470774d828, entries=119, sequenceid=899, filesize=28.7 K 2023-09-23 00:04:15,246 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegion(2948): Finished flush of dataSize ~375.93 KB/384957, heapSize ~452.16 KB/463008, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-09-23 00:04:15,248 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 00:04:15,248 DEBUG [M:0;jenkins-hbase4:44537] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 00:04:15,251 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 00:04:15,251 INFO [M:0;jenkins-hbase4:44537] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-23 00:04:15,252 INFO [M:0;jenkins-hbase4:44537] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44537 2023-09-23 00:04:15,255 DEBUG [M:0;jenkins-hbase4:44537] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44537,1695427310899 already deleted, retry=false 2023-09-23 00:04:15,310 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,310 INFO [RS:0;jenkins-hbase4:44515] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44515,1695427312235; zookeeper connection closed. 2023-09-23 00:04:15,310 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:44515-0x100d616e9310001, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,311 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@47d0392f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@47d0392f 2023-09-23 00:04:15,411 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,411 INFO [M:0;jenkins-hbase4:44537] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44537,1695427310899; zookeeper connection closed. 2023-09-23 00:04:15,411 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): master:44537-0x100d616e9310000, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,511 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,511 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42773,1695427312328; zookeeper connection closed. 2023-09-23 00:04:15,511 DEBUG [Listener at localhost/39051-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100d616e9310003, quorum=127.0.0.1:52502, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 00:04:15,511 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f741e99] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f741e99 2023-09-23 00:04:15,511 INFO [Listener at jenkins-hbase4.apache.org/40639] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-23 00:04:15,512 WARN [Listener at jenkins-hbase4.apache.org/40639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 00:04:15,515 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 00:04:15,619 WARN [BP-816871485-172.31.14.131-1695427307191 heartbeating to localhost/127.0.0.1:33037] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 00:04:15,619 WARN [BP-816871485-172.31.14.131-1695427307191 heartbeating to localhost/127.0.0.1:33037] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-816871485-172.31.14.131-1695427307191 (Datanode Uuid b8a29e98-fb39-4c12-bce6-99b92c63747d) service to localhost/127.0.0.1:33037 2023-09-23 00:04:15,621 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data5/current/BP-816871485-172.31.14.131-1695427307191] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 00:04:15,621 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data6/current/BP-816871485-172.31.14.131-1695427307191] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 00:04:15,622 WARN [Listener at jenkins-hbase4.apache.org/40639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 00:04:15,624 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 00:04:15,727 WARN [BP-816871485-172.31.14.131-1695427307191 heartbeating to localhost/127.0.0.1:33037] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 00:04:15,727 WARN [BP-816871485-172.31.14.131-1695427307191 heartbeating to localhost/127.0.0.1:33037] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-816871485-172.31.14.131-1695427307191 (Datanode Uuid 975b6600-d1ed-44fb-bec8-9e00a7c39cb2) service to localhost/127.0.0.1:33037 2023-09-23 00:04:15,728 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data3/current/BP-816871485-172.31.14.131-1695427307191] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 00:04:15,729 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data4/current/BP-816871485-172.31.14.131-1695427307191] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 00:04:15,730 WARN [Listener at jenkins-hbase4.apache.org/40639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 00:04:15,732 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 00:04:15,835 WARN [BP-816871485-172.31.14.131-1695427307191 heartbeating to localhost/127.0.0.1:33037] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 00:04:15,835 WARN [BP-816871485-172.31.14.131-1695427307191 heartbeating to localhost/127.0.0.1:33037] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-816871485-172.31.14.131-1695427307191 (Datanode Uuid 0bff42e4-de09-46ea-af63-5c7eaf35e3fa) service to localhost/127.0.0.1:33037 2023-09-23 00:04:15,836 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data1/current/BP-816871485-172.31.14.131-1695427307191] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 00:04:15,836 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd54e8a-2b73-cd56-9b04-37a30a866ea6/cluster_cb6b8a72-4256-5725-adc8-93da957b1112/dfs/data/data2/current/BP-816871485-172.31.14.131-1695427307191] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 00:04:15,878 INFO [Listener at jenkins-hbase4.apache.org/40639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 00:04:16,003 INFO [Listener at jenkins-hbase4.apache.org/40639] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-23 00:04:16,087 INFO [Listener at jenkins-hbase4.apache.org/40639] hbase.HBaseTestingUtility(1293): Minicluster is down