2023-07-23 05:06:25,520 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 05:06:25,756 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866 2023-07-23 05:06:25,757 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-23 05:06:25,803 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 05:06:26,062 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 05:06:26,062 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412, deleteOnExit=true 2023-07-23 05:06:26,062 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 05:06:26,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/test.cache.data in system properties and HBase conf 2023-07-23 05:06:26,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 05:06:26,064 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop.log.dir in system properties and HBase conf 2023-07-23 05:06:26,064 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 05:06:26,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 05:06:26,065 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 05:06:26,430 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 05:06:26,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:26,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:26,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 05:06:26,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:26,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 05:06:26,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 05:06:26,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:26,445 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:26,445 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 05:06:26,446 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/nfs.dump.dir in system properties and HBase conf 2023-07-23 05:06:26,446 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir in system properties and HBase conf 2023-07-23 05:06:26,446 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:26,447 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 05:06:26,447 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 05:06:27,067 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 05:06:27,072 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 05:06:27,352 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 05:06:27,533 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 05:06:27,546 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:27,579 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:27,614 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_localhost_41227_hdfs____.feclj0/webapp 2023-07-23 05:06:27,770 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41227 2023-07-23 05:06:27,819 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 05:06:27,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 05:06:28,359 WARN [Listener at localhost/33631] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:28,461 WARN [Listener at localhost/33631] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 05:06:28,482 WARN [Listener at localhost/33631] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:28,491 INFO [Listener at localhost/33631] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:28,501 INFO [Listener at localhost/33631] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_localhost_43639_datanode____.2drom4/webapp 2023-07-23 05:06:28,671 INFO [Listener at localhost/33631] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43639 2023-07-23 05:06:29,173 WARN [Listener at localhost/38471] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:29,225 WARN [Listener at localhost/38471] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 05:06:29,230 WARN [Listener at localhost/38471] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:29,233 INFO [Listener at localhost/38471] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:29,243 INFO [Listener at localhost/38471] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_localhost_33143_datanode____de1yif/webapp 2023-07-23 05:06:29,370 INFO [Listener at localhost/38471] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33143 2023-07-23 05:06:29,390 WARN [Listener at localhost/33261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:29,430 WARN [Listener at localhost/33261] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 05:06:29,434 WARN [Listener at localhost/33261] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:29,436 INFO [Listener at localhost/33261] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:29,442 INFO [Listener at localhost/33261] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_localhost_34865_datanode____azerbx/webapp 2023-07-23 05:06:29,631 INFO [Listener at localhost/33261] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34865 2023-07-23 05:06:29,643 WARN [Listener at localhost/38613] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:29,977 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11ec1351e3074814: Processing first storage report for DS-ee666c67-5509-4402-b661-25399391ae28 from datanode eaac0792-f0d2-432a-9df5-479706923b7b 2023-07-23 05:06:29,979 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11ec1351e3074814: from storage DS-ee666c67-5509-4402-b661-25399391ae28 node DatanodeRegistration(127.0.0.1:46131, datanodeUuid=eaac0792-f0d2-432a-9df5-479706923b7b, infoPort=34321, infoSecurePort=0, ipcPort=33261, storageInfo=lv=-57;cid=testClusterID;nsid=384386871;c=1690088787156), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,979 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11ec1351e3074814: Processing first storage report for DS-bfa17d06-83f4-438e-ba19-2aa8a3e2497d from datanode eaac0792-f0d2-432a-9df5-479706923b7b 2023-07-23 05:06:29,979 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11ec1351e3074814: from storage DS-bfa17d06-83f4-438e-ba19-2aa8a3e2497d node DatanodeRegistration(127.0.0.1:46131, datanodeUuid=eaac0792-f0d2-432a-9df5-479706923b7b, infoPort=34321, infoSecurePort=0, ipcPort=33261, storageInfo=lv=-57;cid=testClusterID;nsid=384386871;c=1690088787156), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,983 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xede34f36043ebf9f: Processing first storage report for DS-524b9051-4bf5-4c50-acc6-871771046c86 from datanode a7b35f85-5c59-4b09-a4ef-1430038c87f5 2023-07-23 05:06:29,984 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xede34f36043ebf9f: from storage DS-524b9051-4bf5-4c50-acc6-871771046c86 node DatanodeRegistration(127.0.0.1:35259, datanodeUuid=a7b35f85-5c59-4b09-a4ef-1430038c87f5, infoPort=35051, infoSecurePort=0, ipcPort=38471, storageInfo=lv=-57;cid=testClusterID;nsid=384386871;c=1690088787156), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,984 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xede34f36043ebf9f: Processing first storage report for DS-02c2fc49-e387-4b6d-bc85-0cdbfb5c375f from datanode a7b35f85-5c59-4b09-a4ef-1430038c87f5 2023-07-23 05:06:29,984 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xede34f36043ebf9f: from storage DS-02c2fc49-e387-4b6d-bc85-0cdbfb5c375f node DatanodeRegistration(127.0.0.1:35259, datanodeUuid=a7b35f85-5c59-4b09-a4ef-1430038c87f5, infoPort=35051, infoSecurePort=0, ipcPort=38471, storageInfo=lv=-57;cid=testClusterID;nsid=384386871;c=1690088787156), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,989 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6f046e8f9dcef8f3: Processing first storage report for DS-9658984f-59a2-4187-96eb-70fb34e40372 from datanode 259a041a-710b-4b26-ab91-a022c9008268 2023-07-23 05:06:29,989 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6f046e8f9dcef8f3: from storage DS-9658984f-59a2-4187-96eb-70fb34e40372 node DatanodeRegistration(127.0.0.1:34069, datanodeUuid=259a041a-710b-4b26-ab91-a022c9008268, infoPort=38467, infoSecurePort=0, ipcPort=38613, storageInfo=lv=-57;cid=testClusterID;nsid=384386871;c=1690088787156), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,990 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6f046e8f9dcef8f3: Processing first storage report for DS-c7de4ea9-741b-4d08-a7ed-f4920e7d850b from datanode 259a041a-710b-4b26-ab91-a022c9008268 2023-07-23 05:06:29,990 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6f046e8f9dcef8f3: from storage DS-c7de4ea9-741b-4d08-a7ed-f4920e7d850b node DatanodeRegistration(127.0.0.1:34069, datanodeUuid=259a041a-710b-4b26-ab91-a022c9008268, infoPort=38467, infoSecurePort=0, ipcPort=38613, storageInfo=lv=-57;cid=testClusterID;nsid=384386871;c=1690088787156), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:30,189 DEBUG [Listener at localhost/38613] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866 2023-07-23 05:06:30,303 INFO [Listener at localhost/38613] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/zookeeper_0, clientPort=59908, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 05:06:30,328 INFO [Listener at localhost/38613] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59908 2023-07-23 05:06:30,339 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:30,342 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:31,049 INFO [Listener at localhost/38613] util.FSUtils(471): Created version file at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 with version=8 2023-07-23 05:06:31,050 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/hbase-staging 2023-07-23 05:06:31,436 INFO [Listener at localhost/38613] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 05:06:32,122 INFO [Listener at localhost/38613] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,172 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,173 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,173 INFO [Listener at localhost/38613] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,173 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,173 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,367 INFO [Listener at localhost/38613] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,458 DEBUG [Listener at localhost/38613] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 05:06:32,571 INFO [Listener at localhost/38613] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46475 2023-07-23 05:06:32,586 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,588 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,611 INFO [Listener at localhost/38613] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46475 connecting to ZooKeeper ensemble=127.0.0.1:59908 2023-07-23 05:06:32,661 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:464750x0, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46475-0x1019092dc0a0000 connected 2023-07-23 05:06:32,712 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,713 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,731 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,741 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46475 2023-07-23 05:06:32,741 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46475 2023-07-23 05:06:32,742 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46475 2023-07-23 05:06:32,743 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46475 2023-07-23 05:06:32,743 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46475 2023-07-23 05:06:32,752 INFO [Listener at localhost/38613] master.HMaster(444): hbase.rootdir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, hbase.cluster.distributed=false 2023-07-23 05:06:32,827 INFO [Listener at localhost/38613] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,827 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,828 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,828 INFO [Listener at localhost/38613] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,828 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,828 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,834 INFO [Listener at localhost/38613] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,838 INFO [Listener at localhost/38613] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41749 2023-07-23 05:06:32,842 INFO [Listener at localhost/38613] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 05:06:32,852 DEBUG [Listener at localhost/38613] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 05:06:32,853 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,855 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,857 INFO [Listener at localhost/38613] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41749 connecting to ZooKeeper ensemble=127.0.0.1:59908 2023-07-23 05:06:32,869 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:417490x0, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,870 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:417490x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41749-0x1019092dc0a0001 connected 2023-07-23 05:06:32,872 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,874 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,874 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41749 2023-07-23 05:06:32,878 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41749 2023-07-23 05:06:32,882 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41749 2023-07-23 05:06:32,883 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41749 2023-07-23 05:06:32,883 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41749 2023-07-23 05:06:32,900 INFO [Listener at localhost/38613] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,901 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,901 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,902 INFO [Listener at localhost/38613] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,902 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,902 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,903 INFO [Listener at localhost/38613] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,908 INFO [Listener at localhost/38613] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33729 2023-07-23 05:06:32,910 INFO [Listener at localhost/38613] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 05:06:32,921 DEBUG [Listener at localhost/38613] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 05:06:32,922 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,929 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,931 INFO [Listener at localhost/38613] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33729 connecting to ZooKeeper ensemble=127.0.0.1:59908 2023-07-23 05:06:32,940 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:337290x0, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,942 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:337290x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,943 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:337290x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,943 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:337290x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33729-0x1019092dc0a0002 connected 2023-07-23 05:06:32,947 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33729 2023-07-23 05:06:32,947 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33729 2023-07-23 05:06:32,948 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33729 2023-07-23 05:06:32,951 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33729 2023-07-23 05:06:32,952 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33729 2023-07-23 05:06:32,965 INFO [Listener at localhost/38613] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,966 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,966 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,966 INFO [Listener at localhost/38613] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,966 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,966 INFO [Listener at localhost/38613] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,966 INFO [Listener at localhost/38613] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,970 INFO [Listener at localhost/38613] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33541 2023-07-23 05:06:32,970 INFO [Listener at localhost/38613] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 05:06:32,978 DEBUG [Listener at localhost/38613] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 05:06:32,980 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,983 INFO [Listener at localhost/38613] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,985 INFO [Listener at localhost/38613] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33541 connecting to ZooKeeper ensemble=127.0.0.1:59908 2023-07-23 05:06:32,991 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:335410x0, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,992 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:335410x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,993 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:335410x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,994 DEBUG [Listener at localhost/38613] zookeeper.ZKUtil(164): regionserver:335410x0, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33541-0x1019092dc0a0003 connected 2023-07-23 05:06:32,999 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33541 2023-07-23 05:06:33,001 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33541 2023-07-23 05:06:33,003 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33541 2023-07-23 05:06:33,006 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33541 2023-07-23 05:06:33,008 DEBUG [Listener at localhost/38613] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33541 2023-07-23 05:06:33,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:33,026 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 05:06:33,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:33,052 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:33,052 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:33,052 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:33,052 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:33,053 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:33,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 05:06:33,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 05:06:33,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46475,1690088791241 from backup master directory 2023-07-23 05:06:33,061 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:33,061 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 05:06:33,062 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:33,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:33,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 05:06:33,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 05:06:33,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/hbase.id with ID: 89522781-0880-4248-88ff-d5ec8356434b 2023-07-23 05:06:33,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:33,286 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:33,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x29be31b4 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:33,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a931ead, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:33,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:33,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 05:06:33,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 05:06:33,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 05:06:33,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 05:06:33,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 05:06:33,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:33,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store-tmp 2023-07-23 05:06:33,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:33,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 05:06:33,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 05:06:33,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 05:06:33,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/WALs/jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:33,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46475%2C1690088791241, suffix=, logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/WALs/jenkins-hbase4.apache.org,46475,1690088791241, archiveDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/oldWALs, maxLogs=10 2023-07-23 05:06:33,680 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK] 2023-07-23 05:06:33,680 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK] 2023-07-23 05:06:33,680 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK] 2023-07-23 05:06:33,692 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 05:06:33,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/WALs/jenkins-hbase4.apache.org,46475,1690088791241/jenkins-hbase4.apache.org%2C46475%2C1690088791241.1690088793611 2023-07-23 05:06:33,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK], DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK], DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK]] 2023-07-23 05:06:33,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:33,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:33,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,890 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,898 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 05:06:33,938 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 05:06:33,954 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:33,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:33,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73590067, jitterRate=0.09657745063304901}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:33,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 05:06:34,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 05:06:34,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 05:06:34,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 05:06:34,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 05:06:34,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 05:06:34,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-23 05:06:34,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 05:06:34,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 05:06:34,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 05:06:34,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 05:06:34,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 05:06:34,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 05:06:34,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 05:06:34,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 05:06:34,186 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 05:06:34,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 05:06:34,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 05:06:34,232 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,232 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,232 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,232 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,232 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46475,1690088791241, sessionid=0x1019092dc0a0000, setting cluster-up flag (Was=false) 2023-07-23 05:06:34,257 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 05:06:34,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:34,311 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 05:06:34,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:34,328 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp 2023-07-23 05:06:34,416 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(951): ClusterId : 89522781-0880-4248-88ff-d5ec8356434b 2023-07-23 05:06:34,418 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(951): ClusterId : 89522781-0880-4248-88ff-d5ec8356434b 2023-07-23 05:06:34,419 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(951): ClusterId : 89522781-0880-4248-88ff-d5ec8356434b 2023-07-23 05:06:34,426 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 05:06:34,426 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 05:06:34,426 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 05:06:34,433 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 05:06:34,433 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 05:06:34,433 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 05:06:34,433 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 05:06:34,441 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 05:06:34,441 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 05:06:34,443 DEBUG [RS:0;jenkins-hbase4:41749] zookeeper.ReadOnlyZKClient(139): Connect 0x73ea8013 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:34,445 DEBUG [RS:1;jenkins-hbase4:33729] zookeeper.ReadOnlyZKClient(139): Connect 0x134db092 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:34,446 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 05:06:34,446 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 05:06:34,449 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 05:06:34,452 DEBUG [RS:2;jenkins-hbase4:33541] zookeeper.ReadOnlyZKClient(139): Connect 0x6110cdad to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:34,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 05:06:34,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 05:06:34,475 DEBUG [RS:0;jenkins-hbase4:41749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36e8000a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:34,476 DEBUG [RS:0;jenkins-hbase4:41749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58cfbc47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:06:34,518 DEBUG [RS:1;jenkins-hbase4:33729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@728ec202, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:34,519 DEBUG [RS:1;jenkins-hbase4:33729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41002b2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:06:34,535 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41749 2023-07-23 05:06:34,536 DEBUG [RS:2;jenkins-hbase4:33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fd73fff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:34,537 DEBUG [RS:2;jenkins-hbase4:33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eea35c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:06:34,542 INFO [RS:0;jenkins-hbase4:41749] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 05:06:34,542 INFO [RS:0;jenkins-hbase4:41749] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 05:06:34,543 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 05:06:34,537 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33729 2023-07-23 05:06:34,549 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33541 2023-07-23 05:06:34,544 INFO [RS:0;jenkins-hbase4:41749] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,553 INFO [RS:1;jenkins-hbase4:33729] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 05:06:34,553 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 05:06:34,551 INFO [RS:2;jenkins-hbase4:33541] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 05:06:34,554 INFO [RS:2;jenkins-hbase4:33541] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 05:06:34,554 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 05:06:34,554 INFO [RS:2;jenkins-hbase4:33541] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,554 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 05:06:34,554 INFO [RS:1;jenkins-hbase4:33729] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 05:06:34,554 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 05:06:34,555 INFO [RS:1;jenkins-hbase4:33729] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,555 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 05:06:34,558 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46475,1690088791241 with isa=jenkins-hbase4.apache.org/172.31.14.131:33541, startcode=1690088792965 2023-07-23 05:06:34,558 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46475,1690088791241 with isa=jenkins-hbase4.apache.org/172.31.14.131:33729, startcode=1690088792900 2023-07-23 05:06:34,558 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46475,1690088791241 with isa=jenkins-hbase4.apache.org/172.31.14.131:41749, startcode=1690088792826 2023-07-23 05:06:34,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 05:06:34,592 DEBUG [RS:2;jenkins-hbase4:33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 05:06:34,592 DEBUG [RS:0;jenkins-hbase4:41749] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 05:06:34,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,593 DEBUG [RS:1;jenkins-hbase4:33729] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 05:06:34,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690088824624 2023-07-23 05:06:34,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 05:06:34,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 05:06:34,643 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 05:06:34,644 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 05:06:34,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 05:06:34,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 05:06:34,662 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:34,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 05:06:34,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 05:06:34,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,678 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37637, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 05:06:34,680 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35819, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 05:06:34,679 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46885, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 05:06:34,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 05:06:34,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 05:06:34,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 05:06:34,695 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46475] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 05:06:34,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 05:06:34,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 05:06:34,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690088794711,5,FailOnTimeoutGroup] 2023-07-23 05:06:34,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690088794712,5,FailOnTimeoutGroup] 2023-07-23 05:06:34,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 05:06:34,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,734 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46475] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,755 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46475] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,765 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 05:06:34,765 WARN [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 05:06:34,766 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:06:34,766 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33631 2023-07-23 05:06:34,766 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 05:06:34,778 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:06:34,778 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:06:34,778 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33631 2023-07-23 05:06:34,778 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 05:06:34,779 DEBUG [RS:2;jenkins-hbase4:33541] zookeeper.ZKUtil(162): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,779 WARN [RS:2;jenkins-hbase4:33541] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:34,785 INFO [RS:2;jenkins-hbase4:33541] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:34,786 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,795 DEBUG [RS:1;jenkins-hbase4:33729] zookeeper.ZKUtil(162): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,795 WARN [RS:1;jenkins-hbase4:33729] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:34,801 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33541,1690088792965] 2023-07-23 05:06:34,799 INFO [RS:1;jenkins-hbase4:33729] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:34,801 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33729,1690088792900] 2023-07-23 05:06:34,801 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,827 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:34,829 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:34,829 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:06:34,831 DEBUG [RS:2;jenkins-hbase4:33541] zookeeper.ZKUtil(162): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,832 DEBUG [RS:2;jenkins-hbase4:33541] zookeeper.ZKUtil(162): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,833 DEBUG [RS:1;jenkins-hbase4:33729] zookeeper.ZKUtil(162): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,840 DEBUG [RS:1;jenkins-hbase4:33729] zookeeper.ZKUtil(162): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,852 DEBUG [RS:2;jenkins-hbase4:33541] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 05:06:34,852 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 05:06:34,867 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46475,1690088791241 with isa=jenkins-hbase4.apache.org/172.31.14.131:41749, startcode=1690088792826 2023-07-23 05:06:34,874 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46475] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:34,879 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:06:34,879 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33631 2023-07-23 05:06:34,880 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 05:06:34,882 INFO [RS:2;jenkins-hbase4:33541] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 05:06:34,882 INFO [RS:1;jenkins-hbase4:33729] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 05:06:34,886 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:06:34,886 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:06:34,886 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:06:34,887 DEBUG [RS:0;jenkins-hbase4:41749] zookeeper.ZKUtil(162): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:34,887 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41749,1690088792826] 2023-07-23 05:06:34,887 WARN [RS:0;jenkins-hbase4:41749] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:34,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,888 INFO [RS:0;jenkins-hbase4:41749] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:34,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,888 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:34,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:34,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:34,898 DEBUG [RS:0;jenkins-hbase4:41749] zookeeper.ZKUtil(162): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:34,898 DEBUG [RS:0;jenkins-hbase4:41749] zookeeper.ZKUtil(162): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:34,899 DEBUG [RS:0;jenkins-hbase4:41749] zookeeper.ZKUtil(162): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:34,903 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 05:06:34,903 INFO [RS:0;jenkins-hbase4:41749] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 05:06:34,908 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:34,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 05:06:34,928 INFO [RS:1;jenkins-hbase4:33729] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 05:06:34,928 INFO [RS:0;jenkins-hbase4:41749] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 05:06:34,931 INFO [RS:2;jenkins-hbase4:33541] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 05:06:34,932 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/info 2023-07-23 05:06:34,933 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 05:06:34,934 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:34,934 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 05:06:34,937 INFO [RS:2;jenkins-hbase4:33541] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 05:06:34,937 INFO [RS:0;jenkins-hbase4:41749] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 05:06:34,938 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,938 INFO [RS:1;jenkins-hbase4:33729] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 05:06:34,939 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,939 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,940 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 05:06:34,944 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/rep_barrier 2023-07-23 05:06:34,945 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 05:06:34,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:34,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 05:06:34,949 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/table 2023-07-23 05:06:34,950 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 05:06:34,950 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 05:06:34,963 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 05:06:34,951 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:34,979 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740 2023-07-23 05:06:34,980 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740 2023-07-23 05:06:34,989 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,989 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,989 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,989 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,989 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,990 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,990 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,990 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:0;jenkins-hbase4:41749] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:2;jenkins-hbase4:33541] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,991 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,992 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,992 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,992 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,992 DEBUG [RS:1;jenkins-hbase4:33729] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,993 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 05:06:34,996 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 05:06:35,010 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,011 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,019 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,031 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:35,032 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68624864, jitterRate=0.022590160369873047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 05:06:35,033 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 05:06:35,033 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 05:06:35,033 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 05:06:35,033 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 05:06:35,033 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 05:06:35,034 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 05:06:35,041 INFO [RS:1;jenkins-hbase4:33729] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 05:06:35,043 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 05:06:35,047 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 05:06:35,046 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33729,1690088792900-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,048 INFO [RS:2;jenkins-hbase4:33541] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 05:06:35,049 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33541,1690088792965-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,051 INFO [RS:0;jenkins-hbase4:41749] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 05:06:35,051 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41749,1690088792826-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,055 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 05:06:35,055 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 05:06:35,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 05:06:35,082 INFO [RS:1;jenkins-hbase4:33729] regionserver.Replication(203): jenkins-hbase4.apache.org,33729,1690088792900 started 2023-07-23 05:06:35,083 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33729,1690088792900, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33729, sessionid=0x1019092dc0a0002 2023-07-23 05:06:35,083 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 05:06:35,083 DEBUG [RS:1;jenkins-hbase4:33729] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:35,083 DEBUG [RS:1;jenkins-hbase4:33729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33729,1690088792900' 2023-07-23 05:06:35,083 DEBUG [RS:1;jenkins-hbase4:33729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 05:06:35,085 DEBUG [RS:1;jenkins-hbase4:33729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 05:06:35,091 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 05:06:35,091 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 05:06:35,092 DEBUG [RS:1;jenkins-hbase4:33729] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:35,092 DEBUG [RS:1;jenkins-hbase4:33729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33729,1690088792900' 2023-07-23 05:06:35,092 DEBUG [RS:1;jenkins-hbase4:33729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:35,092 INFO [RS:2;jenkins-hbase4:33541] regionserver.Replication(203): jenkins-hbase4.apache.org,33541,1690088792965 started 2023-07-23 05:06:35,092 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33541,1690088792965, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33541, sessionid=0x1019092dc0a0003 2023-07-23 05:06:35,092 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 05:06:35,092 DEBUG [RS:1;jenkins-hbase4:33729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:35,092 DEBUG [RS:2;jenkins-hbase4:33541] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:35,097 DEBUG [RS:1;jenkins-hbase4:33729] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 05:06:35,098 INFO [RS:1;jenkins-hbase4:33729] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 05:06:35,098 INFO [RS:1;jenkins-hbase4:33729] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 05:06:35,095 DEBUG [RS:2;jenkins-hbase4:33541] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33541,1690088792965' 2023-07-23 05:06:35,101 DEBUG [RS:2;jenkins-hbase4:33541] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 05:06:35,102 INFO [RS:0;jenkins-hbase4:41749] regionserver.Replication(203): jenkins-hbase4.apache.org,41749,1690088792826 started 2023-07-23 05:06:35,102 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41749,1690088792826, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41749, sessionid=0x1019092dc0a0001 2023-07-23 05:06:35,102 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 05:06:35,102 DEBUG [RS:0;jenkins-hbase4:41749] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:35,102 DEBUG [RS:0;jenkins-hbase4:41749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41749,1690088792826' 2023-07-23 05:06:35,102 DEBUG [RS:0;jenkins-hbase4:41749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 05:06:35,104 DEBUG [RS:2;jenkins-hbase4:33541] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 05:06:35,104 DEBUG [RS:0;jenkins-hbase4:41749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 05:06:35,105 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 05:06:35,105 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 05:06:35,105 DEBUG [RS:2;jenkins-hbase4:33541] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:35,106 DEBUG [RS:2;jenkins-hbase4:33541] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33541,1690088792965' 2023-07-23 05:06:35,106 DEBUG [RS:2;jenkins-hbase4:33541] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:35,106 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 05:06:35,106 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 05:06:35,106 DEBUG [RS:2;jenkins-hbase4:33541] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:35,106 DEBUG [RS:0;jenkins-hbase4:41749] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:35,107 DEBUG [RS:0;jenkins-hbase4:41749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41749,1690088792826' 2023-07-23 05:06:35,107 DEBUG [RS:0;jenkins-hbase4:41749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:35,107 DEBUG [RS:2;jenkins-hbase4:33541] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 05:06:35,107 DEBUG [RS:0;jenkins-hbase4:41749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:35,107 INFO [RS:2;jenkins-hbase4:33541] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 05:06:35,109 INFO [RS:2;jenkins-hbase4:33541] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 05:06:35,110 DEBUG [RS:0;jenkins-hbase4:41749] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 05:06:35,110 INFO [RS:0;jenkins-hbase4:41749] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 05:06:35,110 INFO [RS:0;jenkins-hbase4:41749] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 05:06:35,116 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 05:06:35,124 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 05:06:35,210 INFO [RS:1;jenkins-hbase4:33729] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33729%2C1690088792900, suffix=, logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33729,1690088792900, archiveDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs, maxLogs=32 2023-07-23 05:06:35,220 INFO [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41749%2C1690088792826, suffix=, logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,41749,1690088792826, archiveDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs, maxLogs=32 2023-07-23 05:06:35,221 INFO [RS:2;jenkins-hbase4:33541] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33541%2C1690088792965, suffix=, logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33541,1690088792965, archiveDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs, maxLogs=32 2023-07-23 05:06:35,245 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK] 2023-07-23 05:06:35,245 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK] 2023-07-23 05:06:35,255 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK] 2023-07-23 05:06:35,267 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK] 2023-07-23 05:06:35,276 DEBUG [jenkins-hbase4:46475] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 05:06:35,282 DEBUG [jenkins-hbase4:46475] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:35,298 DEBUG [jenkins-hbase4:46475] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:35,299 DEBUG [jenkins-hbase4:46475] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:35,299 DEBUG [jenkins-hbase4:46475] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:35,299 DEBUG [jenkins-hbase4:46475] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:35,309 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK] 2023-07-23 05:06:35,310 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK] 2023-07-23 05:06:35,313 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41749,1690088792826, state=OPENING 2023-07-23 05:06:35,321 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK] 2023-07-23 05:06:35,322 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK] 2023-07-23 05:06:35,322 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 05:06:35,323 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK] 2023-07-23 05:06:35,324 INFO [RS:1;jenkins-hbase4:33729] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33729,1690088792900/jenkins-hbase4.apache.org%2C33729%2C1690088792900.1690088795213 2023-07-23 05:06:35,324 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:35,325 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 05:06:35,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:06:35,371 DEBUG [RS:1;jenkins-hbase4:33729] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK], DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK], DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK]] 2023-07-23 05:06:35,372 INFO [RS:2;jenkins-hbase4:33541] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33541,1690088792965/jenkins-hbase4.apache.org%2C33541%2C1690088792965.1690088795224 2023-07-23 05:06:35,374 DEBUG [RS:2;jenkins-hbase4:33541] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK], DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK], DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK]] 2023-07-23 05:06:35,377 INFO [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,41749,1690088792826/jenkins-hbase4.apache.org%2C41749%2C1690088792826.1690088795224 2023-07-23 05:06:35,378 DEBUG [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK], DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK], DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK]] 2023-07-23 05:06:35,574 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:35,578 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:06:35,582 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:06:35,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 05:06:35,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:35,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41749%2C1690088792826.meta, suffix=.meta, logDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,41749,1690088792826, archiveDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs, maxLogs=32 2023-07-23 05:06:35,631 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK] 2023-07-23 05:06:35,631 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK] 2023-07-23 05:06:35,634 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK] 2023-07-23 05:06:35,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,41749,1690088792826/jenkins-hbase4.apache.org%2C41749%2C1690088792826.meta.1690088795604.meta 2023-07-23 05:06:35,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34069,DS-9658984f-59a2-4187-96eb-70fb34e40372,DISK], DatanodeInfoWithStorage[127.0.0.1:46131,DS-ee666c67-5509-4402-b661-25399391ae28,DISK], DatanodeInfoWithStorage[127.0.0.1:35259,DS-524b9051-4bf5-4c50-acc6-871771046c86,DISK]] 2023-07-23 05:06:35,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:35,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 05:06:35,669 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:35,670 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 05:06:35,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 05:06:35,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 05:06:35,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 05:06:35,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:35,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 05:06:35,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 05:06:35,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 05:06:35,697 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/info 2023-07-23 05:06:35,699 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/info 2023-07-23 05:06:35,699 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 05:06:35,700 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:35,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 05:06:35,702 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/rep_barrier 2023-07-23 05:06:35,702 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/rep_barrier 2023-07-23 05:06:35,703 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 05:06:35,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:35,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 05:06:35,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/table 2023-07-23 05:06:35,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/table 2023-07-23 05:06:35,706 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 05:06:35,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:35,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740 2023-07-23 05:06:35,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740 2023-07-23 05:06:35,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 05:06:35,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 05:06:35,724 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65564649, jitterRate=-0.02301059663295746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 05:06:35,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 05:06:35,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690088795563 2023-07-23 05:06:35,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 05:06:35,760 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 05:06:35,761 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41749,1690088792826, state=OPEN 2023-07-23 05:06:35,765 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 05:06:35,765 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 05:06:35,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 05:06:35,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41749,1690088792826 in 432 msec 2023-07-23 05:06:35,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 05:06:35,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 692 msec 2023-07-23 05:06:35,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3100 sec 2023-07-23 05:06:35,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690088795791, completionTime=-1 2023-07-23 05:06:35,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 05:06:35,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 05:06:35,866 DEBUG [hconnection-0x3979b582-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:35,869 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:35,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 05:06:35,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690088855891 2023-07-23 05:06:35,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690088915892 2023-07-23 05:06:35,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 99 msec 2023-07-23 05:06:35,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46475,1690088791241-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46475,1690088791241-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46475,1690088791241-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46475, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,933 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 05:06:35,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 05:06:35,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:35,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 05:06:35,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:35,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:36,001 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,004 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3 empty. 2023-07-23 05:06:36,005 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,005 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 05:06:36,049 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:36,052 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4c3ffd061cd23be34f22d11619b827a3, NAME => 'hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:06:36,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:36,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4c3ffd061cd23be34f22d11619b827a3, disabling compactions & flushes 2023-07-23 05:06:36,073 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. after waiting 0 ms 2023-07-23 05:06:36,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,073 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4c3ffd061cd23be34f22d11619b827a3: 2023-07-23 05:06:36,078 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:36,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690088796081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088796081"}]},"ts":"1690088796081"} 2023-07-23 05:06:36,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 05:06:36,126 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:36,133 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088796127"}]},"ts":"1690088796127"} 2023-07-23 05:06:36,138 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 05:06:36,145 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:36,146 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:36,146 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:36,146 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:36,146 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:36,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4c3ffd061cd23be34f22d11619b827a3, ASSIGN}] 2023-07-23 05:06:36,154 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4c3ffd061cd23be34f22d11619b827a3, ASSIGN 2023-07-23 05:06:36,156 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4c3ffd061cd23be34f22d11619b827a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:06:36,309 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 05:06:36,311 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4c3ffd061cd23be34f22d11619b827a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:36,311 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690088796311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088796311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088796311"}]},"ts":"1690088796311"} 2023-07-23 05:06:36,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4c3ffd061cd23be34f22d11619b827a3, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:06:36,476 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:36,476 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:06:36,480 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:06:36,488 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c3ffd061cd23be34f22d11619b827a3, NAME => 'hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:36,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. service=AccessControlService 2023-07-23 05:06:36,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:36,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:36,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,494 INFO [StoreOpener-4c3ffd061cd23be34f22d11619b827a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,497 DEBUG [StoreOpener-4c3ffd061cd23be34f22d11619b827a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/info 2023-07-23 05:06:36,497 DEBUG [StoreOpener-4c3ffd061cd23be34f22d11619b827a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/info 2023-07-23 05:06:36,497 INFO [StoreOpener-4c3ffd061cd23be34f22d11619b827a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c3ffd061cd23be34f22d11619b827a3 columnFamilyName info 2023-07-23 05:06:36,498 INFO [StoreOpener-4c3ffd061cd23be34f22d11619b827a3-1] regionserver.HStore(310): Store=4c3ffd061cd23be34f22d11619b827a3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:36,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:06:36,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:36,515 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c3ffd061cd23be34f22d11619b827a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72883386, jitterRate=0.08604708313941956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:36,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c3ffd061cd23be34f22d11619b827a3: 2023-07-23 05:06:36,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3., pid=6, masterSystemTime=1690088796476 2023-07-23 05:06:36,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,525 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:06:36,527 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4c3ffd061cd23be34f22d11619b827a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:36,527 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690088796526"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088796526"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088796526"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088796526"}]},"ts":"1690088796526"} 2023-07-23 05:06:36,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 05:06:36,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4c3ffd061cd23be34f22d11619b827a3, server=jenkins-hbase4.apache.org,33729,1690088792900 in 211 msec 2023-07-23 05:06:36,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 05:06:36,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4c3ffd061cd23be34f22d11619b827a3, ASSIGN in 388 msec 2023-07-23 05:06:36,544 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:06:36,544 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088796544"}]},"ts":"1690088796544"} 2023-07-23 05:06:36,547 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 05:06:36,554 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:06:36,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 604 msec 2023-07-23 05:06:36,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 05:06:36,569 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 05:06:36,569 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:36,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:36,597 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:36,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 05:06:36,630 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 05:06:36,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-23 05:06:36,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 05:06:36,671 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 05:06:36,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 28 msec 2023-07-23 05:06:36,685 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 05:06:36,688 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 05:06:36,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.628sec 2023-07-23 05:06:36,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 05:06:36,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 05:06:36,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 05:06:36,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46475,1690088791241-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 05:06:36,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46475,1690088791241-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 05:06:36,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:36,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 05:06:36,728 DEBUG [Listener at localhost/38613] zookeeper.ReadOnlyZKClient(139): Connect 0x68214c6c to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:36,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:36,731 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:36,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 05:06:36,742 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:36,743 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169 empty. 2023-07-23 05:06:36,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:36,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 05:06:36,748 DEBUG [Listener at localhost/38613] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504158e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:36,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:36,768 DEBUG [hconnection-0x290efef4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:36,797 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:36,799 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:36,801 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:06:36,801 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0d3a87f7f99de4f4efc6c8e01032169, NAME => 'hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:06:36,801 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 05:06:36,801 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/test.cache.data in system properties and HBase conf 2023-07-23 05:06:36,801 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 05:06:36,801 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop.log.dir in system properties and HBase conf 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 05:06:36,802 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/nfs.dump.dir in system properties and HBase conf 2023-07-23 05:06:36,803 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir in system properties and HBase conf 2023-07-23 05:06:36,804 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:36,804 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 05:06:36,804 INFO [Listener at localhost/38613] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 05:06:36,837 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:36,837 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing d0d3a87f7f99de4f4efc6c8e01032169, disabling compactions & flushes 2023-07-23 05:06:36,837 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:36,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:36,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. after waiting 0 ms 2023-07-23 05:06:36,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:36,838 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:36,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for d0d3a87f7f99de4f4efc6c8e01032169: 2023-07-23 05:06:36,843 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:36,845 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690088796845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088796845"}]},"ts":"1690088796845"} 2023-07-23 05:06:36,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 05:06:36,854 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:36,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088796854"}]},"ts":"1690088796854"} 2023-07-23 05:06:36,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 05:06:36,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:36,862 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:36,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:36,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:36,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:36,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:36,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d0d3a87f7f99de4f4efc6c8e01032169, ASSIGN}] 2023-07-23 05:06:36,867 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d0d3a87f7f99de4f4efc6c8e01032169, ASSIGN 2023-07-23 05:06:36,875 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=d0d3a87f7f99de4f4efc6c8e01032169, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:06:37,026 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 05:06:37,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d0d3a87f7f99de4f4efc6c8e01032169, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:37,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690088797028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088797028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088797028"}]},"ts":"1690088797028"} 2023-07-23 05:06:37,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d0d3a87f7f99de4f4efc6c8e01032169, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:06:37,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:37,199 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:37,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0d3a87f7f99de4f4efc6c8e01032169, NAME => 'hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:37,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. service=AccessControlService 2023-07-23 05:06:37,201 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:37,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:37,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,203 INFO [StoreOpener-d0d3a87f7f99de4f4efc6c8e01032169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,206 DEBUG [StoreOpener-d0d3a87f7f99de4f4efc6c8e01032169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/l 2023-07-23 05:06:37,207 DEBUG [StoreOpener-d0d3a87f7f99de4f4efc6c8e01032169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/l 2023-07-23 05:06:37,207 INFO [StoreOpener-d0d3a87f7f99de4f4efc6c8e01032169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0d3a87f7f99de4f4efc6c8e01032169 columnFamilyName l 2023-07-23 05:06:37,208 INFO [StoreOpener-d0d3a87f7f99de4f4efc6c8e01032169-1] regionserver.HStore(310): Store=d0d3a87f7f99de4f4efc6c8e01032169/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:37,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:06:37,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:37,224 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0d3a87f7f99de4f4efc6c8e01032169; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69406767, jitterRate=0.03424142301082611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:37,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0d3a87f7f99de4f4efc6c8e01032169: 2023-07-23 05:06:37,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169., pid=11, masterSystemTime=1690088797193 2023-07-23 05:06:37,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:37,230 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:06:37,234 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d0d3a87f7f99de4f4efc6c8e01032169, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:37,234 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690088797233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088797233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088797233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088797233"}]},"ts":"1690088797233"} 2023-07-23 05:06:37,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 05:06:37,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d0d3a87f7f99de4f4efc6c8e01032169, server=jenkins-hbase4.apache.org,33729,1690088792900 in 206 msec 2023-07-23 05:06:37,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 05:06:37,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=d0d3a87f7f99de4f4efc6c8e01032169, ASSIGN in 379 msec 2023-07-23 05:06:37,261 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:06:37,262 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088797261"}]},"ts":"1690088797261"} 2023-07-23 05:06:37,264 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 05:06:37,273 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:06:37,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 549 msec 2023-07-23 05:06:37,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:37,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 05:06:37,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 05:06:38,217 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:38,520 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:38,525 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42671_jobhistory____.lije9x/webapp 2023-07-23 05:06:38,708 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 05:06:38,709 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:38,709 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:38,712 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:38,804 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:39,154 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:39,615 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 05:06:39,663 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42671 2023-07-23 05:06:41,215 WARN [Listener at jenkins-hbase4.apache.org/44213] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:41,514 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:06:41,570 WARN [Listener at jenkins-hbase4.apache.org/44213] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 05:06:41,571 INFO [Listener at jenkins-hbase4.apache.org/44213] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:41,577 INFO [Listener at jenkins-hbase4.apache.org/44213] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37461_cluster____icve0p/webapp 2023-07-23 05:06:41,622 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 05:06:41,624 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 05:06:41,625 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 05:06:41,626 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:41,627 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 05:06:41,627 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:41,628 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 05:06:41,628 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 05:06:41,628 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 05:06:41,628 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:41,628 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 05:06:41,628 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 05:06:41,628 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 05:06:41,665 INFO [Listener at jenkins-hbase4.apache.org/44213] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:41,666 INFO [Listener at jenkins-hbase4.apache.org/44213] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 05:06:41,666 INFO [Listener at jenkins-hbase4.apache.org/44213] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:41,666 INFO [Listener at jenkins-hbase4.apache.org/44213] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:41,675 INFO [Listener at jenkins-hbase4.apache.org/44213] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:41,858 INFO [Listener at jenkins-hbase4.apache.org/44213] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:41,945 INFO [Listener at jenkins-hbase4.apache.org/44213] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:41,951 INFO [Listener at jenkins-hbase4.apache.org/44213] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37461 2023-07-23 05:06:42,366 WARN [Listener at jenkins-hbase4.apache.org/36205] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:42,389 WARN [Listener at jenkins-hbase4.apache.org/36205] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 05:06:42,390 INFO [Listener at jenkins-hbase4.apache.org/36205] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:42,395 INFO [Listener at jenkins-hbase4.apache.org/36205] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37829_node____.kg2ihz/webapp 2023-07-23 05:06:42,446 INFO [Listener at jenkins-hbase4.apache.org/36205] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 05:06:42,447 INFO [Listener at jenkins-hbase4.apache.org/36205] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:42,447 INFO [Listener at jenkins-hbase4.apache.org/36205] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:42,447 INFO [Listener at jenkins-hbase4.apache.org/36205] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:42,454 INFO [Listener at jenkins-hbase4.apache.org/36205] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:42,475 INFO [Listener at jenkins-hbase4.apache.org/36205] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:42,564 INFO [Listener at jenkins-hbase4.apache.org/36205] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:42,577 INFO [Listener at jenkins-hbase4.apache.org/36205] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37829 2023-07-23 05:06:42,782 WARN [Listener at jenkins-hbase4.apache.org/41165] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:42,789 WARN [Listener at jenkins-hbase4.apache.org/41165] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 05:06:42,789 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:42,795 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37651_node____.fqwndg/webapp 2023-07-23 05:06:42,864 INFO [Listener at jenkins-hbase4.apache.org/41165] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 05:06:42,865 INFO [Listener at jenkins-hbase4.apache.org/41165] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:42,865 INFO [Listener at jenkins-hbase4.apache.org/41165] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:42,865 INFO [Listener at jenkins-hbase4.apache.org/41165] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:42,874 INFO [Listener at jenkins-hbase4.apache.org/41165] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:42,892 INFO [Listener at jenkins-hbase4.apache.org/41165] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:42,974 INFO [Listener at jenkins-hbase4.apache.org/41165] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:42,982 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37651 2023-07-23 05:06:43,021 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 05:06:43,023 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:43,118 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=172, AvailableMemoryMB=8326 2023-07-23 05:06:43,118 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-23 05:06:43,140 DEBUG [Listener at jenkins-hbase4.apache.org/41165] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 05:06:43,146 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 05:06:43,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:43,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:43,164 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:43,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 05:06:43,167 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:43,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:43,178 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,178 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 empty. 2023-07-23 05:06:43,181 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 empty. 2023-07-23 05:06:43,183 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,184 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,184 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 05:06:43,223 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:43,225 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => cce3a5009ecbfa648b750926ed909b84, NAME => 'testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:06:43,225 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3687c424cb7865047aeba084dbfc1a52, NAME => 'testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:06:43,269 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:43,269 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:43,274 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing cce3a5009ecbfa648b750926ed909b84, disabling compactions & flushes 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 3687c424cb7865047aeba084dbfc1a52, disabling compactions & flushes 2023-07-23 05:06:43,275 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,275 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. after waiting 0 ms 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. after waiting 0 ms 2023-07-23 05:06:43,275 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,275 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,276 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for cce3a5009ecbfa648b750926ed909b84: 2023-07-23 05:06:43,276 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,276 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 3687c424cb7865047aeba084dbfc1a52: 2023-07-23 05:06:43,279 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:43,281 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088803280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088803280"}]},"ts":"1690088803280"} 2023-07-23 05:06:43,281 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088803280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088803280"}]},"ts":"1690088803280"} 2023-07-23 05:06:43,333 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:06:43,334 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:43,335 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088803334"}]},"ts":"1690088803334"} 2023-07-23 05:06:43,337 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 05:06:43,343 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:43,345 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:43,346 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:43,346 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:43,346 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:43,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, ASSIGN}] 2023-07-23 05:06:43,349 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, ASSIGN 2023-07-23 05:06:43,349 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, ASSIGN 2023-07-23 05:06:43,352 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:06:43,352 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:06:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:43,502 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:06:43,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3687c424cb7865047aeba084dbfc1a52, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:43,505 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cce3a5009ecbfa648b750926ed909b84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:43,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088803505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088803505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088803505"}]},"ts":"1690088803505"} 2023-07-23 05:06:43,506 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088803505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088803505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088803505"}]},"ts":"1690088803505"} 2023-07-23 05:06:43,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 3687c424cb7865047aeba084dbfc1a52, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:06:43,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure cce3a5009ecbfa648b750926ed909b84, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:06:43,671 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:43,672 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:06:43,674 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:06:43,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3687c424cb7865047aeba084dbfc1a52, NAME => 'testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:06:43,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. service=AccessControlService 2023-07-23 05:06:43,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:43,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:43,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,689 INFO [StoreOpener-3687c424cb7865047aeba084dbfc1a52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cce3a5009ecbfa648b750926ed909b84, NAME => 'testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:06:43,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. service=AccessControlService 2023-07-23 05:06:43,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:43,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:43,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,692 DEBUG [StoreOpener-3687c424cb7865047aeba084dbfc1a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf 2023-07-23 05:06:43,692 DEBUG [StoreOpener-3687c424cb7865047aeba084dbfc1a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf 2023-07-23 05:06:43,693 INFO [StoreOpener-3687c424cb7865047aeba084dbfc1a52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3687c424cb7865047aeba084dbfc1a52 columnFamilyName cf 2023-07-23 05:06:43,695 INFO [StoreOpener-3687c424cb7865047aeba084dbfc1a52-1] regionserver.HStore(310): Store=3687c424cb7865047aeba084dbfc1a52/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:43,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,700 INFO [StoreOpener-cce3a5009ecbfa648b750926ed909b84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,703 DEBUG [StoreOpener-cce3a5009ecbfa648b750926ed909b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf 2023-07-23 05:06:43,703 DEBUG [StoreOpener-cce3a5009ecbfa648b750926ed909b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf 2023-07-23 05:06:43,703 INFO [StoreOpener-cce3a5009ecbfa648b750926ed909b84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cce3a5009ecbfa648b750926ed909b84 columnFamilyName cf 2023-07-23 05:06:43,704 INFO [StoreOpener-cce3a5009ecbfa648b750926ed909b84-1] regionserver.HStore(310): Store=cce3a5009ecbfa648b750926ed909b84/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:06:43,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:43,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3687c424cb7865047aeba084dbfc1a52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65461827, jitterRate=-0.024542763829231262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:43,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3687c424cb7865047aeba084dbfc1a52: 2023-07-23 05:06:43,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52., pid=15, masterSystemTime=1690088803664 2023-07-23 05:06:43,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:06:43,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:43,740 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3687c424cb7865047aeba084dbfc1a52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:43,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088803739"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088803739"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088803739"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088803739"}]},"ts":"1690088803739"} 2023-07-23 05:06:43,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:43,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cce3a5009ecbfa648b750926ed909b84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62368056, jitterRate=-0.07064354419708252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:43,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cce3a5009ecbfa648b750926ed909b84: 2023-07-23 05:06:43,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84., pid=16, masterSystemTime=1690088803671 2023-07-23 05:06:43,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cce3a5009ecbfa648b750926ed909b84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:43,755 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088803750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088803750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088803750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088803750"}]},"ts":"1690088803750"} 2023-07-23 05:06:43,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:43,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-23 05:06:43,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 3687c424cb7865047aeba084dbfc1a52, server=jenkins-hbase4.apache.org,33729,1690088792900 in 238 msec 2023-07-23 05:06:43,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, ASSIGN in 414 msec 2023-07-23 05:06:43,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-23 05:06:43,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure cce3a5009ecbfa648b750926ed909b84, server=jenkins-hbase4.apache.org,33541,1690088792965 in 248 msec 2023-07-23 05:06:43,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-23 05:06:43,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, ASSIGN in 424 msec 2023-07-23 05:06:43,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:06:43,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088803777"}]},"ts":"1690088803777"} 2023-07-23 05:06:43,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:43,780 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 05:06:43,785 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:06:43,792 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 05:06:43,815 DEBUG [hconnection-0x2999254c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:43,819 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-23 05:06:43,830 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 05:06:43,885 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,885 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,885 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:43,885 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,885 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,894 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,894 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:43,910 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:43,911 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:43,913 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:43,915 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:43,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 754 msec 2023-07-23 05:06:43,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:43,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:43,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:43,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:44,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:44,281 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 05:06:44,281 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-23 05:06:44,282 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:44,288 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-23 05:06:44,289 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:44,289 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-23 05:06:44,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:44,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088804308 (current time:1690088804308). 2023-07-23 05:06:44,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:06:44,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x320f833f to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:44,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fa1d92f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:44,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:44,323 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:44,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x320f833f to 127.0.0.1:59908 2023-07-23 05:06:44,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:44,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x3a54e0a1 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:44,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cf4894e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:44,336 DEBUG [hconnection-0x15ce2e84-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:44,337 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:44,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:44,344 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:44,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a54e0a1 to 127.0.0.1:59908 2023-07-23 05:06:44,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:44,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 05:06:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:06:44,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:44,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:44,400 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:44,401 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690089404401 2023-07-23 05:06:44,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:44,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 05:06:44,405 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:44,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:44,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-23 05:06:44,409 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:44,410 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690089404410 2023-07-23 05:06:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:06:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:06:44,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,446 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 05:06:44,447 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:44,448 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 05:06:44,448 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 05:06:44,448 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,448 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,453 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,453 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,453 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,453 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,454 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,454 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,454 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,454 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:06:44,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 05:06:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 05:06:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:44,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 05:06:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:44,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:44,463 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:44,463 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:44,463 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:44,463 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:44,464 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:44,465 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:44,465 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:44,465 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:44,465 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:44,466 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:44,466 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:44,465 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:44,466 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:44,469 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,469 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799f916a[Count = 1] remaining members to acquire global barrier 2023-07-23 05:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799f916a[Count = 0] remaining members to acquire global barrier 2023-07-23 05:06:44,476 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 05:06:44,476 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,478 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,478 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,478 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,479 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:44,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,479 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,479 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:44,479 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:44,479 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:06:44,480 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,480 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:06:44,481 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:44,481 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:44,481 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:44,481 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. started... 2023-07-23 05:06:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:44,483 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:44,483 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. started... 2023-07-23 05:06:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:44,484 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:44,487 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cce3a5009ecbfa648b750926ed909b84: 2023-07-23 05:06:44,487 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3687c424cb7865047aeba084dbfc1a52: 2023-07-23 05:06:44,488 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,488 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,496 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:44,496 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:44,501 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:06:44,501 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:06:44,511 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:44,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:44,519 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:06:44,550 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. completed. 2023-07-23 05:06:44,550 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:44,551 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:44,551 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:44,551 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,551 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:44,551 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:06:44,553 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:44,553 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,553 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,553 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:06:44,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 05:06:44,720 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:44,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:44,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:44,724 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:06:44,948 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. completed. 2023-07-23 05:06:44,948 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:44,948 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:44,949 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:44,949 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,949 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:44,949 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:06:44,951 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:44,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:06:44,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 05:06:44,957 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 05:06:44,957 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:06:44,957 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:06:44,958 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,958 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,962 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,964 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,964 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,966 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,967 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,967 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,986 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,985 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:44,985 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,986 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,987 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,987 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,987 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:44,987 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,987 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:44,987 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:44,988 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,988 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:44,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:45,024 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:45,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:45,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:45,028 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:06:45,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:45,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 05:06:45,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:45,125 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:45,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690088804402Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690088804986 (+584 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690088804986Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690088805023 (+37 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690088805059 (+36 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690088805125 (+66 ms) 2023-07-23 05:06:45,127 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:45,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 722 msec 2023-07-23 05:06:45,528 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:45,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:45,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:06:45,551 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:45,552 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:45,559 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:45,559 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:45,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:06:45,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33729] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:06:45,566 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 05:06:45,567 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:45,569 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:45,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:45,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088805595 (current time:1690088805595). 2023-07-23 05:06:45,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:06:45,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x74f48f81 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:45,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61095c63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:45,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:45,605 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:45,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74f48f81 to 127.0.0.1:59908 2023-07-23 05:06:45,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:45,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc98d1e to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f1181e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:45,614 DEBUG [hconnection-0x64d02624-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:45,617 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:45,622 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:45,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc98d1e to 127.0.0.1:59908 2023-07-23 05:06:45,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:45,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 05:06:45,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:06:45,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:45,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:45,628 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:45,629 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690089405629 2023-07-23 05:06:45,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:45,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 05:06:45,630 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:06:45,630 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:06:45,632 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:45,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:45,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-23 05:06:45,634 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:45,635 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690089405635 2023-07-23 05:06:45,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 05:06:45,651 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 05:06:45,651 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:45,652 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 05:06:45,652 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 05:06:45,653 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,653 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,654 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:45,654 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:45,654 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:45,654 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:45,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:45,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:45,655 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:45,655 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,655 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,655 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:06:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:45,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:45,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 05:06:45,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 05:06:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:45,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 05:06:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:45,658 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:45,658 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:45,659 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:45,659 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:45,659 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:45,662 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,662 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,662 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:45,668 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9297c8[Count = 1] remaining members to acquire global barrier 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:45,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:45,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:45,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:45,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:45,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9297c8[Count = 0] remaining members to acquire global barrier 2023-07-23 05:06:45,674 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 05:06:45,674 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,679 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,679 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,679 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:45,680 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:45,680 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:45,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,680 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:06:45,680 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. started... 2023-07-23 05:06:45,680 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:06:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:45,681 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3687c424cb7865047aeba084dbfc1a52 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 05:06:45,681 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:45,681 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. started... 2023-07-23 05:06:45,681 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cce3a5009ecbfa648b750926ed909b84 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 05:06:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:45,731 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:45,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:45,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:45,732 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:06:45,776 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/.tmp/cf/91417e94d7a74b08b75e4e3b89f28cb5 2023-07-23 05:06:45,777 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/.tmp/cf/f3b2f81ab318457c9b1ea08c89b8a816 2023-07-23 05:06:45,828 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/.tmp/cf/f3b2f81ab318457c9b1ea08c89b8a816 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf/f3b2f81ab318457c9b1ea08c89b8a816 2023-07-23 05:06:45,828 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/.tmp/cf/91417e94d7a74b08b75e4e3b89f28cb5 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf/91417e94d7a74b08b75e4e3b89f28cb5 2023-07-23 05:06:45,836 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf/91417e94d7a74b08b75e4e3b89f28cb5, entries=47, sequenceid=6, filesize=8.0 K 2023-07-23 05:06:45,836 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf/f3b2f81ab318457c9b1ea08c89b8a816, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 05:06:45,840 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cce3a5009ecbfa648b750926ed909b84 in 159ms, sequenceid=6, compaction requested=false 2023-07-23 05:06:45,841 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3687c424cb7865047aeba084dbfc1a52 in 159ms, sequenceid=6, compaction requested=false 2023-07-23 05:06:45,841 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 05:06:45,841 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 05:06:45,843 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cce3a5009ecbfa648b750926ed909b84: 2023-07-23 05:06:45,843 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3687c424cb7865047aeba084dbfc1a52: 2023-07-23 05:06:45,843 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:45,843 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:45,843 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:45,844 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:45,844 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf/f3b2f81ab318457c9b1ea08c89b8a816] hfiles 2023-07-23 05:06:45,844 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf/91417e94d7a74b08b75e4e3b89f28cb5] hfiles 2023-07-23 05:06:45,844 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf/f3b2f81ab318457c9b1ea08c89b8a816 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:45,844 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf/91417e94d7a74b08b75e4e3b89f28cb5 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:45,873 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. completed. 2023-07-23 05:06:45,873 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:06:45,873 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:45,873 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:45,873 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,874 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:45,874 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:06:45,877 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,877 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:45,877 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:45,877 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:45,877 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. completed. 2023-07-23 05:06:45,877 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:06:45,877 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:45,877 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:45,877 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:06:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:45,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,881 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:45,881 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,881 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:45,881 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:45,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:45,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:06:45,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 05:06:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:45,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:06:45,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 05:06:45,893 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 05:06:45,893 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:06:45,893 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:06:45,893 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 05:06:45,893 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:06:45,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:45,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:45,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:45,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:45,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,896 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:45,896 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:45,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:45,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:45,901 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,901 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:45,906 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:45,906 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,907 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,933 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:45,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:45,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:45,943 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:06:45,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:45,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:45,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:45,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:45,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:45,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,946 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:45,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:45,946 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:45,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 05:06:45,946 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:45,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 05:06:45,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:06:45,947 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:06:45,948 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,948 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:45,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 05:06:45,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:45,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 05:06:46,062 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 05:06:46,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 05:06:46,063 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 05:06:46,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690088805629Consolidate snapshot: snaptb0-testExportWithTargetName at 1690088805947 (+318 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690088805947Writing data manifest for snaptb0-testExportWithTargetName at 1690088805954 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690088805975 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690088806062 (+87 ms) 2023-07-23 05:06:46,065 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:46,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 435 msec 2023-07-23 05:06:46,243 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:46,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:46,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:06:46,248 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248 2023-07-23 05:06:46,248 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33631, tgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248, rawTgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:06:46,317 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:06:46,317 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-851033432_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 05:06:46,317 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 05:06:46,365 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 05:06:46,517 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,517 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,518 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,518 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,519 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,520 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,520 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,625 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-2691383743331106051.jar 2023-07-23 05:06:46,626 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,626 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,627 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,628 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,628 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,629 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:46,629 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:06:46,630 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:06:46,630 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:06:46,631 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:06:46,631 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:06:46,632 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:06:46,633 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:06:46,633 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:06:46,633 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:06:46,634 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:06:46,637 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:06:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:46,639 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:46,639 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:06:46,640 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:06:48,032 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:06:48,038 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 05:06:48,051 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 05:06:48,646 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:06:48,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:06:48,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:49,195 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:06:54,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:56,356 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:59,174 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0001_000001 (auth:SIMPLE) 2023-07-23 05:07:01,024 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:01,026 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:01,034 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 05:07:01,035 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:01,035 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:01,036 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 05:07:01,036 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 05:07:01,036 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 05:07:01,037 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248/.hbase-snapshot/testExportWithTargetName 2023-07-23 05:07:01,037 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 05:07:01,037 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088806248/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 05:07:01,047 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 05:07:01,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 05:07:01,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,064 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088821063"}]},"ts":"1690088821063"} 2023-07-23 05:07:01,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 05:07:01,065 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 05:07:01,067 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 05:07:01,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, UNASSIGN}] 2023-07-23 05:07:01,071 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, UNASSIGN 2023-07-23 05:07:01,071 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, UNASSIGN 2023-07-23 05:07:01,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cce3a5009ecbfa648b750926ed909b84, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:01,073 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3687c424cb7865047aeba084dbfc1a52, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:01,073 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088821072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088821072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088821072"}]},"ts":"1690088821072"} 2023-07-23 05:07:01,073 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088821072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088821072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088821072"}]},"ts":"1690088821072"} 2023-07-23 05:07:01,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure cce3a5009ecbfa648b750926ed909b84, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:01,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 3687c424cb7865047aeba084dbfc1a52, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:07:01,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 05:07:01,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:07:01,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3687c424cb7865047aeba084dbfc1a52, disabling compactions & flushes 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cce3a5009ecbfa648b750926ed909b84, disabling compactions & flushes 2023-07-23 05:07:01,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:07:01,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. after waiting 0 ms 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. after waiting 0 ms 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:07:01,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:07:01,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:01,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:01,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:01,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:01,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52. 2023-07-23 05:07:01,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84. 2023-07-23 05:07:01,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3687c424cb7865047aeba084dbfc1a52: 2023-07-23 05:07:01,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cce3a5009ecbfa648b750926ed909b84: 2023-07-23 05:07:01,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:07:01,263 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3687c424cb7865047aeba084dbfc1a52, regionState=CLOSED 2023-07-23 05:07:01,263 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088821263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088821263"}]},"ts":"1690088821263"} 2023-07-23 05:07:01,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:07:01,265 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cce3a5009ecbfa648b750926ed909b84, regionState=CLOSED 2023-07-23 05:07:01,265 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088821265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088821265"}]},"ts":"1690088821265"} 2023-07-23 05:07:01,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-23 05:07:01,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 3687c424cb7865047aeba084dbfc1a52, server=jenkins-hbase4.apache.org,33729,1690088792900 in 190 msec 2023-07-23 05:07:01,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-23 05:07:01,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3687c424cb7865047aeba084dbfc1a52, UNASSIGN in 199 msec 2023-07-23 05:07:01,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure cce3a5009ecbfa648b750926ed909b84, server=jenkins-hbase4.apache.org,33541,1690088792965 in 192 msec 2023-07-23 05:07:01,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-23 05:07:01,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce3a5009ecbfa648b750926ed909b84, UNASSIGN in 201 msec 2023-07-23 05:07:01,273 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088821273"}]},"ts":"1690088821273"} 2023-07-23 05:07:01,275 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 05:07:01,277 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 05:07:01,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-23 05:07:01,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 05:07:01,368 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 05:07:01,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 05:07:01,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,394 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 05:07:01,397 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,400 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 05:07:01,403 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,403 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,403 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,403 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:07:01,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:07:01,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:07:01,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:07:01,404 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:07:01,405 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:07:01,406 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:01,409 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/recovered.edits] 2023-07-23 05:07:01,409 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/recovered.edits] 2023-07-23 05:07:01,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 05:07:01,417 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf/91417e94d7a74b08b75e4e3b89f28cb5 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/cf/91417e94d7a74b08b75e4e3b89f28cb5 2023-07-23 05:07:01,417 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf/f3b2f81ab318457c9b1ea08c89b8a816 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/cf/f3b2f81ab318457c9b1ea08c89b8a816 2023-07-23 05:07:01,422 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52/recovered.edits/9.seqid 2023-07-23 05:07:01,422 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84/recovered.edits/9.seqid 2023-07-23 05:07:01,423 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/3687c424cb7865047aeba084dbfc1a52 2023-07-23 05:07:01,423 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportWithTargetName/cce3a5009ecbfa648b750926ed909b84 2023-07-23 05:07:01,423 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 05:07:01,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,454 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 05:07:01,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 05:07:01,467 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 05:07:01,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088821468"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:01,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088821468"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:01,473 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:07:01,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cce3a5009ecbfa648b750926ed909b84, NAME => 'testtb-testExportWithTargetName,,1690088803156.cce3a5009ecbfa648b750926ed909b84.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3687c424cb7865047aeba084dbfc1a52, NAME => 'testtb-testExportWithTargetName,1,1690088803156.3687c424cb7865047aeba084dbfc1a52.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:07:01,473 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 05:07:01,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088821473"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:01,476 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 05:07:01,478 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:07:01,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 95 msec 2023-07-23 05:07:01,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 05:07:01,512 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 05:07:01,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 05:07:01,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 05:07:01,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 05:07:01,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 05:07:01,586 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 709) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:51280 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:41782 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:35534 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2044595113_1 at /127.0.0.1:57026 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:36457 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3979b582-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:34941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3979b582-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2044595113_1 at /127.0.0.1:48612 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6559 (was 8326) 2023-07-23 05:07:01,586 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-23 05:07:01,608 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=178, AvailableMemoryMB=6552 2023-07-23 05:07:01,608 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-23 05:07:01,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:07:01,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:01,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:01,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 05:07:01,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:01,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:07:01,626 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:01,626 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:01,627 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 empty. 2023-07-23 05:07:01,627 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a empty. 2023-07-23 05:07:01,627 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:01,627 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:01,628 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 05:07:01,655 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:01,660 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb5b56175e06658c9b40cff05899cb7a, NAME => 'testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:01,660 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 38a3aa85c0bed6f2faad7904f33f4eb1, NAME => 'testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:01,690 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:01,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing bb5b56175e06658c9b40cff05899cb7a, disabling compactions & flushes 2023-07-23 05:07:01,692 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:01,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:01,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. after waiting 0 ms 2023-07-23 05:07:01,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:01,692 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:01,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for bb5b56175e06658c9b40cff05899cb7a: 2023-07-23 05:07:01,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:01,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 38a3aa85c0bed6f2faad7904f33f4eb1, disabling compactions & flushes 2023-07-23 05:07:01,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:01,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:01,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. after waiting 0 ms 2023-07-23 05:07:01,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:01,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:01,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 38a3aa85c0bed6f2faad7904f33f4eb1: 2023-07-23 05:07:01,701 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:01,702 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088821702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088821702"}]},"ts":"1690088821702"} 2023-07-23 05:07:01,702 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088821702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088821702"}]},"ts":"1690088821702"} 2023-07-23 05:07:01,705 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:01,707 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:01,707 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088821707"}]},"ts":"1690088821707"} 2023-07-23 05:07:01,709 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 05:07:01,714 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:01,716 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:01,716 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:01,717 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:01,717 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:01,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, ASSIGN}] 2023-07-23 05:07:01,721 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, ASSIGN 2023-07-23 05:07:01,722 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, ASSIGN 2023-07-23 05:07:01,724 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:07:01,725 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:07:01,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:07:01,875 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:01,878 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bb5b56175e06658c9b40cff05899cb7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:01,878 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=38a3aa85c0bed6f2faad7904f33f4eb1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:01,878 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088821878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088821878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088821878"}]},"ts":"1690088821878"} 2023-07-23 05:07:01,878 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088821878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088821878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088821878"}]},"ts":"1690088821878"} 2023-07-23 05:07:01,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure bb5b56175e06658c9b40cff05899cb7a, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:01,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 38a3aa85c0bed6f2faad7904f33f4eb1, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:07:01,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:07:02,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38a3aa85c0bed6f2faad7904f33f4eb1, NAME => 'testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:07:02,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb5b56175e06658c9b40cff05899cb7a, NAME => 'testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. service=AccessControlService 2023-07-23 05:07:02,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. service=AccessControlService 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,039 INFO [StoreOpener-38a3aa85c0bed6f2faad7904f33f4eb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,039 INFO [StoreOpener-bb5b56175e06658c9b40cff05899cb7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,040 DEBUG [StoreOpener-38a3aa85c0bed6f2faad7904f33f4eb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf 2023-07-23 05:07:02,040 DEBUG [StoreOpener-38a3aa85c0bed6f2faad7904f33f4eb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf 2023-07-23 05:07:02,040 DEBUG [StoreOpener-bb5b56175e06658c9b40cff05899cb7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf 2023-07-23 05:07:02,040 DEBUG [StoreOpener-bb5b56175e06658c9b40cff05899cb7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf 2023-07-23 05:07:02,041 INFO [StoreOpener-38a3aa85c0bed6f2faad7904f33f4eb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38a3aa85c0bed6f2faad7904f33f4eb1 columnFamilyName cf 2023-07-23 05:07:02,041 INFO [StoreOpener-bb5b56175e06658c9b40cff05899cb7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb5b56175e06658c9b40cff05899cb7a columnFamilyName cf 2023-07-23 05:07:02,041 INFO [StoreOpener-38a3aa85c0bed6f2faad7904f33f4eb1-1] regionserver.HStore(310): Store=38a3aa85c0bed6f2faad7904f33f4eb1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:02,043 INFO [StoreOpener-bb5b56175e06658c9b40cff05899cb7a-1] regionserver.HStore(310): Store=bb5b56175e06658c9b40cff05899cb7a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:02,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:02,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 38a3aa85c0bed6f2faad7904f33f4eb1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70246526, jitterRate=0.046754807233810425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 38a3aa85c0bed6f2faad7904f33f4eb1: 2023-07-23 05:07:02,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb5b56175e06658c9b40cff05899cb7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74515946, jitterRate=0.11037412285804749}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb5b56175e06658c9b40cff05899cb7a: 2023-07-23 05:07:02,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1., pid=31, masterSystemTime=1690088822033 2023-07-23 05:07:02,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a., pid=30, masterSystemTime=1690088822033 2023-07-23 05:07:02,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,055 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=38a3aa85c0bed6f2faad7904f33f4eb1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,056 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088822055"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088822055"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088822055"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088822055"}]},"ts":"1690088822055"} 2023-07-23 05:07:02,056 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bb5b56175e06658c9b40cff05899cb7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,056 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088822056"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088822056"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088822056"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088822056"}]},"ts":"1690088822056"} 2023-07-23 05:07:02,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-23 05:07:02,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 38a3aa85c0bed6f2faad7904f33f4eb1, server=jenkins-hbase4.apache.org,33729,1690088792900 in 176 msec 2023-07-23 05:07:02,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-23 05:07:02,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure bb5b56175e06658c9b40cff05899cb7a, server=jenkins-hbase4.apache.org,33541,1690088792965 in 178 msec 2023-07-23 05:07:02,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, ASSIGN in 345 msec 2023-07-23 05:07:02,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-23 05:07:02,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, ASSIGN in 346 msec 2023-07-23 05:07:02,067 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:02,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088822067"}]},"ts":"1690088822067"} 2023-07-23 05:07:02,068 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 05:07:02,071 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:02,071 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 05:07:02,073 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:07:02,074 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:02,074 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:02,074 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:02,074 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:02,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:02,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:02,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:02,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:02,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 464 msec 2023-07-23 05:07:02,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:07:02,228 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 05:07:02,228 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-23 05:07:02,228 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:02,232 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-23 05:07:02,232 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:02,232 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-23 05:07:02,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:02,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088822235 (current time:1690088822235). 2023-07-23 05:07:02,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:02,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x3f57938d to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:02,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce71d66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:02,247 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:02,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f57938d to 127.0.0.1:59908 2023-07-23 05:07:02,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:02,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x20099538 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:02,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2341b14f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:02,261 DEBUG [hconnection-0x769946c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:02,264 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:02,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:02,269 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:02,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20099538 to 127.0.0.1:59908 2023-07-23 05:07:02,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:02,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:07:02,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:02,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:02,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:02,276 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:02,277 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089422277 2023-07-23 05:07:02,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 05:07:02,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:02,278 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:02,278 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:02,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:02,279 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:02,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-23 05:07:02,282 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:02,283 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089422283 2023-07-23 05:07:02,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,297 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 05:07:02,297 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,298 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 05:07:02,298 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:07:02,299 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,299 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,301 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,301 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,301 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,301 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:02,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,304 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:02,304 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:02,304 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,304 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:02,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,308 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:02,309 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:02,309 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:02,309 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:02,314 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,315 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:02,315 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:02,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71d9bdcc[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:02,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71d9bdcc[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:02,321 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:07:02,321 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:02,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:02,324 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,324 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. started... 2023-07-23 05:07:02,324 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,324 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:02,324 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. started... 2023-07-23 05:07:02,325 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,325 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:02,326 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:02,326 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,326 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:02,328 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38a3aa85c0bed6f2faad7904f33f4eb1: 2023-07-23 05:07:02,328 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb5b56175e06658c9b40cff05899cb7a: 2023-07-23 05:07:02,328 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,328 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,328 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:02,328 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:02,329 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:02,329 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:02,350 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. completed. 2023-07-23 05:07:02,350 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,350 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:02,350 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. completed. 2023-07-23 05:07:02,351 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:02,351 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:02,352 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:02,352 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:02,353 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,354 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,354 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,355 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:07:02,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:07:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:07:02,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:07:02,363 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 05:07:02,363 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:02,363 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:02,363 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,364 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:02,365 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,365 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,366 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,366 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,367 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,368 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,369 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,370 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,370 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,374 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,374 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,376 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,376 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,376 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,376 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,377 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,377 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,377 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,377 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,378 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:02,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:02,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:02,380 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:02,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,426 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 05:07:02,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,426 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:02,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690088822277Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690088822374 (+97 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690088822374Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690088822380 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690088822389 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690088822426 (+37 ms) 2023-07-23 05:07:02,429 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:02,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 151 msec 2023-07-23 05:07:02,581 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:02,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:02,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:02,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33729] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:02,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:02,599 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 05:07:02,599 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,601 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:02,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088822612 (current time:1690088822612). 2023-07-23 05:07:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:02,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x40a2d636 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:02,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59ac0ac9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:02,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:02,623 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:02,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40a2d636 to 127.0.0.1:59908 2023-07-23 05:07:02,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:02,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x5f7e2a54 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:02,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3078ed47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:02,633 DEBUG [hconnection-0x44b109d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:02,634 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:02,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:02,640 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:02,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f7e2a54 to 127.0.0.1:59908 2023-07-23 05:07:02,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:02,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:07:02,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:02,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:02,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:02,645 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:02,646 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089422646 2023-07-23 05:07:02,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:02,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 05:07:02,647 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:02,647 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:02,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:02,648 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:02,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-23 05:07:02,651 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:02,651 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089422651 2023-07-23 05:07:02,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 05:07:02,662 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 05:07:02,662 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,663 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 05:07:02,663 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:07:02,664 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,664 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,665 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,665 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,665 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,665 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,666 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,666 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,666 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,666 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,667 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:02,667 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:02,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 05:07:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:02,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 05:07:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:02,669 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:02,669 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,669 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:02,669 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:02,669 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:02,670 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:02,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:02,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:02,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:02,672 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,672 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,672 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,672 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,672 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,673 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,673 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,673 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:02,672 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,673 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,673 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b8feba1[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:02,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b8feba1[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:02,677 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:07:02,677 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:02,679 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:02,680 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:02,680 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,680 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:02,680 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. started... 2023-07-23 05:07:02,680 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:02,680 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. started... 2023-07-23 05:07:02,680 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,680 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:02,680 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:02,680 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 38a3aa85c0bed6f2faad7904f33f4eb1 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 05:07:02,680 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bb5b56175e06658c9b40cff05899cb7a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 05:07:02,681 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:02,681 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,681 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:02,697 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/.tmp/cf/d6022004195e42f88ef12de4ac80817e 2023-07-23 05:07:02,700 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/.tmp/cf/3a175bb4158e405db00d4193733e70e7 2023-07-23 05:07:02,707 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/.tmp/cf/d6022004195e42f88ef12de4ac80817e as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf/d6022004195e42f88ef12de4ac80817e 2023-07-23 05:07:02,709 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/.tmp/cf/3a175bb4158e405db00d4193733e70e7 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf/3a175bb4158e405db00d4193733e70e7 2023-07-23 05:07:02,713 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf/d6022004195e42f88ef12de4ac80817e, entries=2, sequenceid=6, filesize=5.0 K 2023-07-23 05:07:02,716 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf/3a175bb4158e405db00d4193733e70e7, entries=48, sequenceid=6, filesize=8.1 K 2023-07-23 05:07:02,717 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 38a3aa85c0bed6f2faad7904f33f4eb1 in 37ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:02,717 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 05:07:02,718 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38a3aa85c0bed6f2faad7904f33f4eb1: 2023-07-23 05:07:02,718 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for bb5b56175e06658c9b40cff05899cb7a in 38ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:02,718 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb5b56175e06658c9b40cff05899cb7a: 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf/d6022004195e42f88ef12de4ac80817e] hfiles 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf/d6022004195e42f88ef12de4ac80817e for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf/3a175bb4158e405db00d4193733e70e7] hfiles 2023-07-23 05:07:02,719 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf/3a175bb4158e405db00d4193733e70e7 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:02,739 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. completed. 2023-07-23 05:07:02,739 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:02,739 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. completed. 2023-07-23 05:07:02,739 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:02,747 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:02,748 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:02,748 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,748 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,748 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:02,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:02,749 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:02,749 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,749 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:02,751 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:02,750 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:07:02,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:07:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:07:02,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:07:02,762 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 05:07:02,762 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:02,762 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:02,762 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 05:07:02,762 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:02,763 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,763 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,763 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,764 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,763 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,763 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:02,764 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,764 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:02,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,765 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,766 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,769 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,769 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:02,770 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,781 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:02,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 05:07:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 05:07:02,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:02,783 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,783 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:02,784 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:02,784 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,784 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,783 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:02,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 05:07:02,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,835 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690088822646Consolidate snapshot: snaptb0-testExportFileSystemState at 1690088822783 (+137 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690088822783Writing data manifest for snaptb0-testExportFileSystemState at 1690088822791 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690088822803 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690088822834 (+31 ms) 2023-07-23 05:07:02,837 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:02,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 190 msec 2023-07-23 05:07:02,951 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:02,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:02,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:02,956 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956 2023-07-23 05:07:02,956 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33631, tgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956, rawTgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:02,980 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:02,980 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1350469148_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:02,980 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 05:07:02,990 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:03,022 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,023 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,023 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,024 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,024 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,025 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,025 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,104 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-8172488064741731928.jar 2023-07-23 05:07:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,106 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,106 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,106 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:03,107 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:03,107 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:03,108 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:03,108 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:03,108 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:03,109 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:03,109 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:03,110 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:03,110 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:03,110 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:03,111 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:03,111 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:03,112 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:03,112 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:03,112 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:03,113 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:03,113 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:03,537 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:03,539 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 05:07:03,542 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 05:07:05,379 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:05,379 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:05,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0001_000001 (auth:SIMPLE) 2023-07-23 05:07:06,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:06,888 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:07:10,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:12,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:15,729 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:17,758 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:17,759 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:17,766 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 05:07:17,766 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:17,766 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:17,766 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 05:07:17,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 05:07:17,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 05:07:17,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 05:07:17,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 05:07:17,768 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088822956/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 05:07:17,774 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 05:07:17,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 05:07:17,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:17,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 05:07:17,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088837779"}]},"ts":"1690088837779"} 2023-07-23 05:07:17,781 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 05:07:17,784 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 05:07:17,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, UNASSIGN}] 2023-07-23 05:07:17,787 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, UNASSIGN 2023-07-23 05:07:17,787 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, UNASSIGN 2023-07-23 05:07:17,788 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=38a3aa85c0bed6f2faad7904f33f4eb1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:17,788 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb5b56175e06658c9b40cff05899cb7a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:17,788 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088837788"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088837788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088837788"}]},"ts":"1690088837788"} 2023-07-23 05:07:17,788 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088837788"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088837788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088837788"}]},"ts":"1690088837788"} 2023-07-23 05:07:17,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure bb5b56175e06658c9b40cff05899cb7a, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:17,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 38a3aa85c0bed6f2faad7904f33f4eb1, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:07:17,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 05:07:17,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:17,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb5b56175e06658c9b40cff05899cb7a, disabling compactions & flushes 2023-07-23 05:07:17,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:17,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:17,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. after waiting 0 ms 2023-07-23 05:07:17,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:17,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 38a3aa85c0bed6f2faad7904f33f4eb1, disabling compactions & flushes 2023-07-23 05:07:17,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. after waiting 0 ms 2023-07-23 05:07:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:17,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a. 2023-07-23 05:07:17,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb5b56175e06658c9b40cff05899cb7a: 2023-07-23 05:07:17,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:17,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1. 2023-07-23 05:07:17,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 38a3aa85c0bed6f2faad7904f33f4eb1: 2023-07-23 05:07:17,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:17,962 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb5b56175e06658c9b40cff05899cb7a, regionState=CLOSED 2023-07-23 05:07:17,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:17,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088837962"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088837962"}]},"ts":"1690088837962"} 2023-07-23 05:07:17,963 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=38a3aa85c0bed6f2faad7904f33f4eb1, regionState=CLOSED 2023-07-23 05:07:17,963 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088837963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088837963"}]},"ts":"1690088837963"} 2023-07-23 05:07:17,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-23 05:07:17,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure bb5b56175e06658c9b40cff05899cb7a, server=jenkins-hbase4.apache.org,33541,1690088792965 in 175 msec 2023-07-23 05:07:17,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-23 05:07:17,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 38a3aa85c0bed6f2faad7904f33f4eb1, server=jenkins-hbase4.apache.org,33729,1690088792900 in 175 msec 2023-07-23 05:07:17,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb5b56175e06658c9b40cff05899cb7a, UNASSIGN in 182 msec 2023-07-23 05:07:17,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-23 05:07:17,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38a3aa85c0bed6f2faad7904f33f4eb1, UNASSIGN in 182 msec 2023-07-23 05:07:17,970 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088837970"}]},"ts":"1690088837970"} 2023-07-23 05:07:17,971 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 05:07:17,973 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 05:07:17,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 199 msec 2023-07-23 05:07:18,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 05:07:18,081 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 05:07:18,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 05:07:18,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:18,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:18,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 05:07:18,087 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:18,088 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 05:07:18,091 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,091 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,091 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,091 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:18,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:18,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:18,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:18,093 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:18,093 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:18,093 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,093 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,093 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,093 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,093 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:18,094 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,094 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,093 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 05:07:18,095 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/recovered.edits] 2023-07-23 05:07:18,095 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/recovered.edits] 2023-07-23 05:07:18,100 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf/d6022004195e42f88ef12de4ac80817e to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/cf/d6022004195e42f88ef12de4ac80817e 2023-07-23 05:07:18,100 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf/3a175bb4158e405db00d4193733e70e7 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/cf/3a175bb4158e405db00d4193733e70e7 2023-07-23 05:07:18,104 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1/recovered.edits/9.seqid 2023-07-23 05:07:18,104 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a/recovered.edits/9.seqid 2023-07-23 05:07:18,104 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/38a3aa85c0bed6f2faad7904f33f4eb1 2023-07-23 05:07:18,104 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemState/bb5b56175e06658c9b40cff05899cb7a 2023-07-23 05:07:18,104 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 05:07:18,107 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:18,110 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 05:07:18,112 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 05:07:18,113 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:18,113 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 05:07:18,113 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088838113"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:18,113 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088838113"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:18,115 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:07:18,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 38a3aa85c0bed6f2faad7904f33f4eb1, NAME => 'testtb-testExportFileSystemState,,1690088821610.38a3aa85c0bed6f2faad7904f33f4eb1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb5b56175e06658c9b40cff05899cb7a, NAME => 'testtb-testExportFileSystemState,1,1690088821610.bb5b56175e06658c9b40cff05899cb7a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:07:18,115 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 05:07:18,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088838115"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:18,118 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 05:07:18,120 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:18,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-23 05:07:18,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 05:07:18,196 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 05:07:18,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 05:07:18,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:18,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 05:07:18,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 05:07:18,234 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: hconnection-0x3979b582-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:45569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1948 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:41960 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403072775_1 at /127.0.0.1:55460 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403072775_1 at /127.0.0.1:51312 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:51330 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:55484 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6230 (was 6552) 2023-07-23 05:07:18,235 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 05:07:18,254 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=179, AvailableMemoryMB=6229 2023-07-23 05:07:18,254 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 05:07:18,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:07:18,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:18,259 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:18,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 05:07:18,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:18,260 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:18,263 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,263 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,264 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 empty. 2023-07-23 05:07:18,264 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a empty. 2023-07-23 05:07:18,264 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,264 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,264 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 05:07:18,282 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:18,284 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 86e45a107cc467f96906500ade4c7930, NAME => 'testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:18,284 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3be5f5ca7dd62f33a99d2e3c89cd5a4a, NAME => 'testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:18,309 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:18,309 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 86e45a107cc467f96906500ade4c7930, disabling compactions & flushes 2023-07-23 05:07:18,309 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,309 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,309 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:18,309 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. after waiting 0 ms 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3be5f5ca7dd62f33a99d2e3c89cd5a4a, disabling compactions & flushes 2023-07-23 05:07:18,310 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,310 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 86e45a107cc467f96906500ade4c7930: 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. after waiting 0 ms 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,310 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,310 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3be5f5ca7dd62f33a99d2e3c89cd5a4a: 2023-07-23 05:07:18,313 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:18,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088838313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088838313"}]},"ts":"1690088838313"} 2023-07-23 05:07:18,314 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088838313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088838313"}]},"ts":"1690088838313"} 2023-07-23 05:07:18,316 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:18,317 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:18,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088838317"}]},"ts":"1690088838317"} 2023-07-23 05:07:18,318 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 05:07:18,321 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:18,322 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:18,322 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:18,322 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:18,322 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:18,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, ASSIGN}] 2023-07-23 05:07:18,325 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, ASSIGN 2023-07-23 05:07:18,325 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, ASSIGN 2023-07-23 05:07:18,326 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41749,1690088792826; forceNewPlan=false, retain=false 2023-07-23 05:07:18,326 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:07:18,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:18,476 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:18,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3be5f5ca7dd62f33a99d2e3c89cd5a4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,479 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=86e45a107cc467f96906500ade4c7930, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088838478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088838478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088838478"}]},"ts":"1690088838478"} 2023-07-23 05:07:18,479 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088838478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088838478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088838478"}]},"ts":"1690088838478"} 2023-07-23 05:07:18,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 3be5f5ca7dd62f33a99d2e3c89cd5a4a, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:18,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 86e45a107cc467f96906500ade4c7930, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:07:18,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:18,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3be5f5ca7dd62f33a99d2e3c89cd5a4a, NAME => 'testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:07:18,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. service=AccessControlService 2023-07-23 05:07:18,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 86e45a107cc467f96906500ade4c7930, NAME => 'testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:07:18,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. service=AccessControlService 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,641 INFO [StoreOpener-3be5f5ca7dd62f33a99d2e3c89cd5a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,642 INFO [StoreOpener-86e45a107cc467f96906500ade4c7930-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,643 DEBUG [StoreOpener-3be5f5ca7dd62f33a99d2e3c89cd5a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf 2023-07-23 05:07:18,643 DEBUG [StoreOpener-3be5f5ca7dd62f33a99d2e3c89cd5a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf 2023-07-23 05:07:18,643 DEBUG [StoreOpener-86e45a107cc467f96906500ade4c7930-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf 2023-07-23 05:07:18,643 DEBUG [StoreOpener-86e45a107cc467f96906500ade4c7930-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf 2023-07-23 05:07:18,643 INFO [StoreOpener-3be5f5ca7dd62f33a99d2e3c89cd5a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be5f5ca7dd62f33a99d2e3c89cd5a4a columnFamilyName cf 2023-07-23 05:07:18,644 INFO [StoreOpener-86e45a107cc467f96906500ade4c7930-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86e45a107cc467f96906500ade4c7930 columnFamilyName cf 2023-07-23 05:07:18,644 INFO [StoreOpener-3be5f5ca7dd62f33a99d2e3c89cd5a4a-1] regionserver.HStore(310): Store=3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:18,644 INFO [StoreOpener-86e45a107cc467f96906500ade4c7930-1] regionserver.HStore(310): Store=86e45a107cc467f96906500ade4c7930/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:18,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:18,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 86e45a107cc467f96906500ade4c7930; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69595614, jitterRate=0.03705546259880066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:18,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 86e45a107cc467f96906500ade4c7930: 2023-07-23 05:07:18,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3be5f5ca7dd62f33a99d2e3c89cd5a4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60824885, jitterRate=-0.0936385840177536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:18,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3be5f5ca7dd62f33a99d2e3c89cd5a4a: 2023-07-23 05:07:18,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a., pid=45, masterSystemTime=1690088838633 2023-07-23 05:07:18,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930., pid=46, masterSystemTime=1690088838633 2023-07-23 05:07:18,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,657 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3be5f5ca7dd62f33a99d2e3c89cd5a4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,657 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088838657"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088838657"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088838657"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088838657"}]},"ts":"1690088838657"} 2023-07-23 05:07:18,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,658 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=86e45a107cc467f96906500ade4c7930, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,658 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088838658"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088838658"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088838658"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088838658"}]},"ts":"1690088838658"} 2023-07-23 05:07:18,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-23 05:07:18,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 3be5f5ca7dd62f33a99d2e3c89cd5a4a, server=jenkins-hbase4.apache.org,33541,1690088792965 in 178 msec 2023-07-23 05:07:18,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-23 05:07:18,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 86e45a107cc467f96906500ade4c7930, server=jenkins-hbase4.apache.org,41749,1690088792826 in 178 msec 2023-07-23 05:07:18,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, ASSIGN in 340 msec 2023-07-23 05:07:18,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-23 05:07:18,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, ASSIGN in 341 msec 2023-07-23 05:07:18,665 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:18,666 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088838665"}]},"ts":"1690088838665"} 2023-07-23 05:07:18,667 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 05:07:18,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:18,674 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 05:07:18,676 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 05:07:18,677 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,677 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,677 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,677 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:18,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:18,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:18,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:18,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:18,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 423 msec 2023-07-23 05:07:18,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:18,864 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 05:07:18,864 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-23 05:07:18,865 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:18,868 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-23 05:07:18,868 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:18,868 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-23 05:07:18,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:18,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088838871 (current time:1690088838871). 2023-07-23 05:07:18,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:18,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x10aa0b08 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:18,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@779947d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:18,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:18,881 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:18,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10aa0b08 to 127.0.0.1:59908 2023-07-23 05:07:18,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:18,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x48f9083b to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:18,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@84ba867, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:18,889 DEBUG [hconnection-0x35d1c162-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:18,892 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:18,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:18,897 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:18,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48f9083b to 127.0.0.1:59908 2023-07-23 05:07:18,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:18,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 05:07:18,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:18,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:18,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:18,903 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:18,903 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690089438903 2023-07-23 05:07:18,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:18,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 05:07:18,904 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:18,905 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:18,908 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:18,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:18,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-23 05:07:18,910 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:18,910 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690089438910 2023-07-23 05:07:18,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,924 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 05:07:18,924 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:18,926 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 05:07:18,926 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 05:07:18,926 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,926 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,928 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:18,928 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:18,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:18,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:18,928 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:18,928 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,928 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,928 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,929 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,929 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:18,929 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:18,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:18,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:18,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:18,935 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:18,935 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:18,935 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:18,935 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:18,935 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:18,935 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,937 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:18,937 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:18,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:18,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1e337b[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:18,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:18,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1e337b[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:18,942 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 05:07:18,942 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,945 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,946 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:18,946 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:18,946 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:18,946 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. started... 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:18,946 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:18,947 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86e45a107cc467f96906500ade4c7930: 2023-07-23 05:07:18,947 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. started... 2023-07-23 05:07:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:18,947 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,948 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3be5f5ca7dd62f33a99d2e3c89cd5a4a: 2023-07-23 05:07:18,948 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:18,948 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:18,948 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,949 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:18,949 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:18,954 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:18,954 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:18,954 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:18,967 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. completed. 2023-07-23 05:07:18,967 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:18,969 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:18,969 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. completed. 2023-07-23 05:07:18,970 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:18,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:18,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,973 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41749,1690088792826': 2023-07-23 05:07:18,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 05:07:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:07:18,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 05:07:18,980 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 05:07:18,980 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:18,980 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:18,980 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,980 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,982 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:18,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:18,982 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,981 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:18,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:18,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,983 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,985 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:18,986 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,986 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:18,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:18,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:18,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:18,989 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:18,989 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:18,990 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,991 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:18,991 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:18,991 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,991 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:18,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:18,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:18,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:18,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,005 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:19,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:19,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:19,006 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:19,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:19,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 05:07:19,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:19,043 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:19,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690088838904Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690088838989 (+85 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690088838990 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690088838994 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690088839011 (+17 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690088839042 (+31 ms) 2023-07-23 05:07:19,045 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:19,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 141 msec 2023-07-23 05:07:19,206 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:19,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:19,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:19,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:19,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41749] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 05:07:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:19,223 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:19,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:19,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088839239 (current time:1690088839239). 2023-07-23 05:07:19,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:19,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x2a3d485d to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:19,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce1e019, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:19,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:19,256 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:19,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a3d485d to 127.0.0.1:59908 2023-07-23 05:07:19,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:19,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x2f0a2ec5 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:19,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f35e4d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:19,267 DEBUG [hconnection-0x7c47300e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:19,270 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:19,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:19,274 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:19,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f0a2ec5 to 127.0.0.1:59908 2023-07-23 05:07:19,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:19,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 05:07:19,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:19,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:19,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:19,280 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:19,281 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690089439281 2023-07-23 05:07:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:19,281 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 05:07:19,282 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:19,282 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:19,283 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:19,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:19,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-23 05:07:19,286 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:19,287 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690089439287 2023-07-23 05:07:19,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 05:07:19,300 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 05:07:19,300 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:19,301 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 05:07:19,301 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 05:07:19,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,304 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,304 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:19,304 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:19,304 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:19,305 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,305 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:19,305 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,305 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 05:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:19,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:19,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 05:07:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:19,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 05:07:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:19,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 05:07:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:19,308 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:19,310 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:19,310 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:19,310 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:19,310 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:19,310 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:19,310 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:19,312 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,312 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:19,312 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,312 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,312 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:19,312 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,313 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:19,313 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,313 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:19,313 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:19,313 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f9d5a7[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:19,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:19,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f9d5a7[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:19,316 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 05:07:19,316 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,317 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,317 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,317 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,318 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:19,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:19,318 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:19,318 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,318 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:19,318 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:19,318 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. started... 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:19,319 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:19,319 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3be5f5ca7dd62f33a99d2e3c89cd5a4a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 05:07:19,319 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. started... 2023-07-23 05:07:19,319 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 86e45a107cc467f96906500ade4c7930 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 05:07:19,323 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:19,323 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:19,323 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:19,345 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/.tmp/cf/5f46cf244aa04658be521bfe403014cf 2023-07-23 05:07:19,350 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/.tmp/cf/6bfcf63eb05a4d3687225187f4e39453 2023-07-23 05:07:19,353 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/.tmp/cf/5f46cf244aa04658be521bfe403014cf as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf/5f46cf244aa04658be521bfe403014cf 2023-07-23 05:07:19,358 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/.tmp/cf/6bfcf63eb05a4d3687225187f4e39453 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf/6bfcf63eb05a4d3687225187f4e39453 2023-07-23 05:07:19,359 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf/5f46cf244aa04658be521bfe403014cf, entries=48, sequenceid=6, filesize=8.1 K 2023-07-23 05:07:19,369 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 3be5f5ca7dd62f33a99d2e3c89cd5a4a in 50ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:19,369 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 05:07:19,370 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3be5f5ca7dd62f33a99d2e3c89cd5a4a: 2023-07-23 05:07:19,370 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:19,370 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:19,370 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf/5f46cf244aa04658be521bfe403014cf] hfiles 2023-07-23 05:07:19,370 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf/5f46cf244aa04658be521bfe403014cf for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:19,373 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf/6bfcf63eb05a4d3687225187f4e39453, entries=2, sequenceid=6, filesize=5.0 K 2023-07-23 05:07:19,374 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 86e45a107cc467f96906500ade4c7930 in 55ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:19,376 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86e45a107cc467f96906500ade4c7930: 2023-07-23 05:07:19,376 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:19,376 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:19,376 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf/6bfcf63eb05a4d3687225187f4e39453] hfiles 2023-07-23 05:07:19,376 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf/6bfcf63eb05a4d3687225187f4e39453 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:19,382 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:19,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:19,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:19,384 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:19,391 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. completed. 2023-07-23 05:07:19,391 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:19,393 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:07:19,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 05:07:19,401 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. completed. 2023-07-23 05:07:19,401 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:19,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:19,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:19,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:19,402 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:19,403 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,403 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:19,403 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:19,403 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:19,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:19,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:19,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41749,1690088792826': 2023-07-23 05:07:19,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 05:07:19,408 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 05:07:19,408 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:19,408 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:19,408 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 05:07:19,408 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:19,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,410 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:19,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:19,411 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:19,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,412 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:19,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,414 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:19,414 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:19,414 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:19,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:19,422 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:19,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 05:07:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:19,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:19,422 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:19,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 05:07:19,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:19,424 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,424 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,425 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:19,425 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,425 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:19,425 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:19,425 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,425 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 05:07:19,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,483 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690088839281Consolidate snapshot: snaptb0-testConsecutiveExports at 1690088839424 (+143 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690088839424Writing data manifest for snaptb0-testConsecutiveExports at 1690088839431 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690088839446 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690088839482 (+36 ms) 2023-07-23 05:07:19,485 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:19,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 203 msec 2023-07-23 05:07:19,584 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:19,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:19,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:19,585 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585 2023-07-23 05:07:19,586 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:19,607 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:19,608 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3dadc57c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,608 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 05:07:19,615 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,704 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-6213421983081441805.jar 2023-07-23 05:07:19,705 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,705 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,705 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,706 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,706 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,706 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:19,707 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:19,707 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:19,707 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:19,708 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:19,708 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:19,709 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:19,709 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:19,709 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:19,710 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:19,710 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:19,710 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:19,711 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:19,711 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:19,711 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:19,712 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:19,712 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:19,712 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:20,095 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:20,097 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 05:07:20,099 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 05:07:21,918 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:21,918 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:21,920 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:22,393 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:23,579 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:07:26,872 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:29,130 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:32,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:34,299 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:34,299 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:34,303 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 05:07:34,303 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:34,304 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:34,304 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@23c05c40 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:34,306 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:34,329 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:34,329 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@248cd9bd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:34,329 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 05:07:34,339 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:34,351 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,351 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,352 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,352 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,352 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,352 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,353 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,426 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-5445167103791504838.jar 2023-07-23 05:07:34,427 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,427 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,428 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,428 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,428 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,429 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:34,429 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:34,429 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:34,430 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:34,430 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:34,430 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:34,431 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:34,431 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:34,432 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:34,432 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:34,432 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:34,433 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:34,433 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:34,434 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:34,434 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:34,434 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:34,435 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:34,435 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:34,793 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:34,795 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 05:07:34,797 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 05:07:38,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:38,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:38,514 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:39,242 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:43,837 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:46,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:51,242 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:51,242 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:51,246 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 05:07:51,247 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:51,247 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:51,247 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:51,252 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:51,252 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:51,252 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@23c05c40 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:51,253 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:51,253 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/local-export-1690088839585/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:51,271 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 05:07:51,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 05:07:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 05:07:51,282 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088871282"}]},"ts":"1690088871282"} 2023-07-23 05:07:51,284 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 05:07:51,287 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 05:07:51,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, UNASSIGN}] 2023-07-23 05:07:51,291 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, UNASSIGN 2023-07-23 05:07:51,293 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, UNASSIGN 2023-07-23 05:07:51,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3be5f5ca7dd62f33a99d2e3c89cd5a4a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:51,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088871295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088871295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088871295"}]},"ts":"1690088871295"} 2023-07-23 05:07:51,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=86e45a107cc467f96906500ade4c7930, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:51,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088871296"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088871296"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088871296"}]},"ts":"1690088871296"} 2023-07-23 05:07:51,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 3be5f5ca7dd62f33a99d2e3c89cd5a4a, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:51,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 86e45a107cc467f96906500ade4c7930, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:07:51,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 05:07:51,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3be5f5ca7dd62f33a99d2e3c89cd5a4a, disabling compactions & flushes 2023-07-23 05:07:51,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. after waiting 0 ms 2023-07-23 05:07:51,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:51,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:51,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 86e45a107cc467f96906500ade4c7930, disabling compactions & flushes 2023-07-23 05:07:51,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:51,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:51,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. after waiting 0 ms 2023-07-23 05:07:51,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:51,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:51,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:51,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a. 2023-07-23 05:07:51,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3be5f5ca7dd62f33a99d2e3c89cd5a4a: 2023-07-23 05:07:51,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:51,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:51,498 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3be5f5ca7dd62f33a99d2e3c89cd5a4a, regionState=CLOSED 2023-07-23 05:07:51,498 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088871498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088871498"}]},"ts":"1690088871498"} 2023-07-23 05:07:51,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:51,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930. 2023-07-23 05:07:51,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 86e45a107cc467f96906500ade4c7930: 2023-07-23 05:07:51,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:51,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=86e45a107cc467f96906500ade4c7930, regionState=CLOSED 2023-07-23 05:07:51,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088871502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088871502"}]},"ts":"1690088871502"} 2023-07-23 05:07:51,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-23 05:07:51,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 3be5f5ca7dd62f33a99d2e3c89cd5a4a, server=jenkins-hbase4.apache.org,33541,1690088792965 in 202 msec 2023-07-23 05:07:51,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3be5f5ca7dd62f33a99d2e3c89cd5a4a, UNASSIGN in 243 msec 2023-07-23 05:07:51,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-23 05:07:51,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 86e45a107cc467f96906500ade4c7930, server=jenkins-hbase4.apache.org,41749,1690088792826 in 233 msec 2023-07-23 05:07:51,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-23 05:07:51,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86e45a107cc467f96906500ade4c7930, UNASSIGN in 263 msec 2023-07-23 05:07:51,555 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088871554"}]},"ts":"1690088871554"} 2023-07-23 05:07:51,556 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 05:07:51,558 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 05:07:51,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 287 msec 2023-07-23 05:07:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 05:07:51,583 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 05:07:51,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 05:07:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,587 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 05:07:51,588 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,591 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 05:07:51,594 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:51,595 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:51,595 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,595 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,595 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,596 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 05:07:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 05:07:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 05:07:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 05:07:51,597 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/recovered.edits] 2023-07-23 05:07:51,597 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/recovered.edits] 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:51,598 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:51,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 05:07:51,603 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf/5f46cf244aa04658be521bfe403014cf to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/cf/5f46cf244aa04658be521bfe403014cf 2023-07-23 05:07:51,604 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf/6bfcf63eb05a4d3687225187f4e39453 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/cf/6bfcf63eb05a4d3687225187f4e39453 2023-07-23 05:07:51,607 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a/recovered.edits/9.seqid 2023-07-23 05:07:51,608 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930/recovered.edits/9.seqid 2023-07-23 05:07:51,608 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/3be5f5ca7dd62f33a99d2e3c89cd5a4a 2023-07-23 05:07:51,608 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testConsecutiveExports/86e45a107cc467f96906500ade4c7930 2023-07-23 05:07:51,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 05:07:51,611 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,613 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 05:07:51,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 05:07:51,616 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,616 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 05:07:51,616 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088871616"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:51,616 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088871616"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:51,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:07:51,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 86e45a107cc467f96906500ade4c7930, NAME => 'testtb-testConsecutiveExports,,1690088838255.86e45a107cc467f96906500ade4c7930.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3be5f5ca7dd62f33a99d2e3c89cd5a4a, NAME => 'testtb-testConsecutiveExports,1,1690088838255.3be5f5ca7dd62f33a99d2e3c89cd5a4a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:07:51,618 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 05:07:51,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088871618"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:51,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 05:07:51,625 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:51,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-07-23 05:07:51,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 05:07:51,701 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 05:07:51,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 05:07:51,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:51,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 05:07:51,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 05:07:51,792 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 765), OpenFileDescriptor=894 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=438 (was 305) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5777 (was 6229) 2023-07-23 05:07:51,792 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-23 05:07:51,813 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=438, ProcessCount=181, AvailableMemoryMB=5774 2023-07-23 05:07:51,813 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-23 05:07:51,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:07:51,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,819 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:51,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 05:07:51,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:51,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:51,823 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:51,823 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:51,823 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af empty. 2023-07-23 05:07:51,823 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 empty. 2023-07-23 05:07:51,824 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:51,824 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:51,824 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 05:07:51,850 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:51,852 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9e1c19c9141b3b398b6a624ecf37c7af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:51,852 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6c5fbe080c6b8eaeaa8b65f43b4d3be0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:51,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:51,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9e1c19c9141b3b398b6a624ecf37c7af, disabling compactions & flushes 2023-07-23 05:07:51,875 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:51,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:51,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. after waiting 0 ms 2023-07-23 05:07:51,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:51,875 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:51,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9e1c19c9141b3b398b6a624ecf37c7af: 2023-07-23 05:07:51,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:51,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6c5fbe080c6b8eaeaa8b65f43b4d3be0, disabling compactions & flushes 2023-07-23 05:07:51,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:51,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:51,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. after waiting 0 ms 2023-07-23 05:07:51,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:51,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:51,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6c5fbe080c6b8eaeaa8b65f43b4d3be0: 2023-07-23 05:07:51,881 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:51,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088871882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088871882"}]},"ts":"1690088871882"} 2023-07-23 05:07:51,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088871882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088871882"}]},"ts":"1690088871882"} 2023-07-23 05:07:51,889 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:51,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:51,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088871890"}]},"ts":"1690088871890"} 2023-07-23 05:07:51,892 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 05:07:51,897 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:51,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:51,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:51,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:51,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:51,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, ASSIGN}] 2023-07-23 05:07:51,901 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, ASSIGN 2023-07-23 05:07:51,901 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, ASSIGN 2023-07-23 05:07:51,902 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41749,1690088792826; forceNewPlan=false, retain=false 2023-07-23 05:07:51,902 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:07:51,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:52,052 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:52,055 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9e1c19c9141b3b398b6a624ecf37c7af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6c5fbe080c6b8eaeaa8b65f43b4d3be0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,056 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088872055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088872055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088872055"}]},"ts":"1690088872055"} 2023-07-23 05:07:52,056 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088872055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088872055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088872055"}]},"ts":"1690088872055"} 2023-07-23 05:07:52,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 9e1c19c9141b3b398b6a624ecf37c7af, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:07:52,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 6c5fbe080c6b8eaeaa8b65f43b4d3be0, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:07:52,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:52,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:52,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c5fbe080c6b8eaeaa8b65f43b4d3be0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:07:52,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:52,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e1c19c9141b3b398b6a624ecf37c7af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:07:52,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. service=AccessControlService 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. service=AccessControlService 2023-07-23 05:07:52,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:52,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,227 INFO [StoreOpener-6c5fbe080c6b8eaeaa8b65f43b4d3be0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,227 INFO [StoreOpener-9e1c19c9141b3b398b6a624ecf37c7af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,229 DEBUG [StoreOpener-6c5fbe080c6b8eaeaa8b65f43b4d3be0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf 2023-07-23 05:07:52,229 DEBUG [StoreOpener-9e1c19c9141b3b398b6a624ecf37c7af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf 2023-07-23 05:07:52,229 DEBUG [StoreOpener-9e1c19c9141b3b398b6a624ecf37c7af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf 2023-07-23 05:07:52,229 DEBUG [StoreOpener-6c5fbe080c6b8eaeaa8b65f43b4d3be0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf 2023-07-23 05:07:52,230 INFO [StoreOpener-9e1c19c9141b3b398b6a624ecf37c7af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e1c19c9141b3b398b6a624ecf37c7af columnFamilyName cf 2023-07-23 05:07:52,230 INFO [StoreOpener-6c5fbe080c6b8eaeaa8b65f43b4d3be0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c5fbe080c6b8eaeaa8b65f43b4d3be0 columnFamilyName cf 2023-07-23 05:07:52,231 INFO [StoreOpener-9e1c19c9141b3b398b6a624ecf37c7af-1] regionserver.HStore(310): Store=9e1c19c9141b3b398b6a624ecf37c7af/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:52,231 INFO [StoreOpener-6c5fbe080c6b8eaeaa8b65f43b4d3be0-1] regionserver.HStore(310): Store=6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:52,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:07:52,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:52,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c5fbe080c6b8eaeaa8b65f43b4d3be0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62655017, jitterRate=-0.0663674920797348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:52,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c5fbe080c6b8eaeaa8b65f43b4d3be0: 2023-07-23 05:07:52,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0., pid=61, masterSystemTime=1690088872219 2023-07-23 05:07:52,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:07:52,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:52,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:52,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:52,250 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6c5fbe080c6b8eaeaa8b65f43b4d3be0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,250 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088872250"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088872250"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088872250"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088872250"}]},"ts":"1690088872250"} 2023-07-23 05:07:52,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9e1c19c9141b3b398b6a624ecf37c7af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62564746, jitterRate=-0.06771263480186462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:52,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9e1c19c9141b3b398b6a624ecf37c7af: 2023-07-23 05:07:52,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af., pid=60, masterSystemTime=1690088872219 2023-07-23 05:07:52,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:52,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:52,255 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9e1c19c9141b3b398b6a624ecf37c7af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,256 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088872255"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088872255"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088872255"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088872255"}]},"ts":"1690088872255"} 2023-07-23 05:07:52,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-23 05:07:52,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 6c5fbe080c6b8eaeaa8b65f43b4d3be0, server=jenkins-hbase4.apache.org,41749,1690088792826 in 185 msec 2023-07-23 05:07:52,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, ASSIGN in 358 msec 2023-07-23 05:07:52,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-23 05:07:52,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 9e1c19c9141b3b398b6a624ecf37c7af, server=jenkins-hbase4.apache.org,33729,1690088792900 in 192 msec 2023-07-23 05:07:52,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-23 05:07:52,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, ASSIGN in 361 msec 2023-07-23 05:07:52,266 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:52,267 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088872266"}]},"ts":"1690088872266"} 2023-07-23 05:07:52,268 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 05:07:52,271 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:52,271 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 05:07:52,273 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 05:07:52,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:52,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:52,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:52,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:52,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:52,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:52,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:52,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:52,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 462 msec 2023-07-23 05:07:52,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:52,425 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 05:07:52,425 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-23 05:07:52,425 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:52,428 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-23 05:07:52,428 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:52,428 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-23 05:07:52,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:52,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088872433 (current time:1690088872433). 2023-07-23 05:07:52,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:52,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x06c03c51 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:52,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d01ae72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:52,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:52,455 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:52,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06c03c51 to 127.0.0.1:59908 2023-07-23 05:07:52,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:52,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x6074676a to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:52,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6751fd81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:52,475 DEBUG [hconnection-0x5713bd27-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:52,476 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:52,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:52,489 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6074676a to 127.0.0.1:59908 2023-07-23 05:07:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 05:07:52,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:52,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:52,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:52,499 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:52,502 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690089472502 2023-07-23 05:07:52,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:52,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,503 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:52,503 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:52,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:52,505 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:52,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 11 msec 2023-07-23 05:07:52,508 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:52,509 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690089472509 2023-07-23 05:07:52,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,540 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 05:07:52,540 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,541 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 05:07:52,542 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 05:07:52,594 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,594 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,596 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,596 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,596 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,596 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,597 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,597 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,598 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,598 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 05:07:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 05:07:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,599 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:52,599 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:52,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,600 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:52,600 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,601 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:52,602 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:52,602 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,602 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:52,602 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:52,603 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:52,603 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:52,603 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,604 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:52,605 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:52,605 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:52,605 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:52,605 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:52,605 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:52,606 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,607 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:52,606 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,607 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,608 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,609 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,609 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,609 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:52,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:52,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:52,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f23b09[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:52,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f23b09[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:52,615 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 05:07:52,615 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:52,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,620 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:52,620 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:52,620 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:52,620 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:52,621 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:52,621 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:52,621 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:52,621 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. started... 2023-07-23 05:07:52,624 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:52,624 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:52,624 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:52,624 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. started... 2023-07-23 05:07:52,627 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e1c19c9141b3b398b6a624ecf37c7af: 2023-07-23 05:07:52,627 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c5fbe080c6b8eaeaa8b65f43b4d3be0: 2023-07-23 05:07:52,627 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,627 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,628 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:52,628 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,627 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:52,628 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:52,628 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,628 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:52,628 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:52,628 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:52,629 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,629 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:52,655 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. completed. 2023-07-23 05:07:52,655 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:52,660 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,660 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:52,660 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:52,670 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. completed. 2023-07-23 05:07:52,670 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:52,670 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,671 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,675 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,675 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,675 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,675 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41749,1690088792826': 2023-07-23 05:07:52,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 05:07:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:07:52,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 05:07:52,688 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 05:07:52,688 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:52,689 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:52,689 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,689 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,691 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,692 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,692 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,693 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,695 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,697 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,698 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,712 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,714 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:52,715 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,715 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:52,715 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:52,715 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-23 05:07:52,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,712 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,715 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,807 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:52,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:52,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:52,810 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:07:52,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 05:07:52,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,839 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690088872502Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088872712 (+210 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088872712Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088872719 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088872752 (+33 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690088872832 (+80 ms) 2023-07-23 05:07:52,842 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:52,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 339 msec 2023-07-23 05:07:53,110 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:53,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:53,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:53,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33729] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:53,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41749] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:53,128 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,128 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:53,128 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:53,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:53,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088873146 (current time:1690088873146). 2023-07-23 05:07:53,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:53,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x532e9c28 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:53,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fa246fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:53,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:53,165 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x532e9c28 to 127.0.0.1:59908 2023-07-23 05:07:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x1d070a95 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:53,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a6f0ac1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:53,174 DEBUG [hconnection-0x77373ed6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:53,177 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:53,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:53,186 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d070a95 to 127.0.0.1:59908 2023-07-23 05:07:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 05:07:53,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:53,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:53,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:53,194 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:53,195 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690089473195 2023-07-23 05:07:53,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:53,196 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,197 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:53,197 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:53,198 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:53,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:53,199 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-23 05:07:53,200 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:53,201 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690089473201 2023-07-23 05:07:53,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,222 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 05:07:53,222 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:53,224 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 05:07:53,224 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 05:07:53,297 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:53,297 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,297 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:53,298 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:53,299 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:53,299 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:53,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:53,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:53,299 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:53,299 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:53,301 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:53,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,301 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:53,301 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:53,301 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:53,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,301 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:53,302 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,303 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:53,303 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:53,302 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:53,302 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:53,303 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:53,304 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:53,305 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,305 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:53,306 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,306 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:53,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,308 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,309 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,309 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:53,309 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,309 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d340975[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:53,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:53,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d340975[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:53,316 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 05:07:53,316 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:53,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,317 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:53,317 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:53,317 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:53,317 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:53,318 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:53,318 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,318 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:53,318 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:53,318 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. started... 2023-07-23 05:07:53,318 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. started... 2023-07-23 05:07:53,318 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9e1c19c9141b3b398b6a624ecf37c7af 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-23 05:07:53,318 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c5fbe080c6b8eaeaa8b65f43b4d3be0 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-23 05:07:53,319 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:53,319 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:53,319 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:53,351 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/.tmp/cf/a2ff83e05aef4c5c895f253c9f728589 2023-07-23 05:07:53,353 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/.tmp/cf/4d26f3ee64044e60babfe075ad2b4428 2023-07-23 05:07:53,361 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/.tmp/cf/4d26f3ee64044e60babfe075ad2b4428 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf/4d26f3ee64044e60babfe075ad2b4428 2023-07-23 05:07:53,362 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/.tmp/cf/a2ff83e05aef4c5c895f253c9f728589 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf/a2ff83e05aef4c5c895f253c9f728589 2023-07-23 05:07:53,368 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf/4d26f3ee64044e60babfe075ad2b4428, entries=49, sequenceid=6, filesize=8.1 K 2023-07-23 05:07:53,368 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf/a2ff83e05aef4c5c895f253c9f728589, entries=1, sequenceid=6, filesize=4.9 K 2023-07-23 05:07:53,369 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 6c5fbe080c6b8eaeaa8b65f43b4d3be0 in 51ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:53,369 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 05:07:53,370 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c5fbe080c6b8eaeaa8b65f43b4d3be0: 2023-07-23 05:07:53,370 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 9e1c19c9141b3b398b6a624ecf37c7af in 52ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e1c19c9141b3b398b6a624ecf37c7af: 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf/4d26f3ee64044e60babfe075ad2b4428] hfiles 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf/4d26f3ee64044e60babfe075ad2b4428 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,372 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf/a2ff83e05aef4c5c895f253c9f728589] hfiles 2023-07-23 05:07:53,373 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf/a2ff83e05aef4c5c895f253c9f728589 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,393 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. completed. 2023-07-23 05:07:53,393 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:07:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:53,395 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,395 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:53,395 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:53,395 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,398 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. completed. 2023-07-23 05:07:53,398 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:07:53,398 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,398 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:53,401 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:53,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:53,401 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41749,1690088792826': 2023-07-23 05:07:53,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 05:07:53,414 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 05:07:53,414 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:53,414 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:53,414 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,414 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:53,418 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,418 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,418 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:53,418 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,418 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,419 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:53,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:53,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:53,419 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,419 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:53,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:53,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:53,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:53,423 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:53,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:53,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:53,423 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,426 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,426 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:53,427 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:53,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:53,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:53,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:53,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:53,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:53,430 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:53,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:53,430 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:53,434 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:53,434 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:53,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:53,434 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:53,434 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,435 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,498 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:53,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:53,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:53,500 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:07:53,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 05:07:53,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,504 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690088873196Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690088873430 (+234 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690088873430Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690088873440 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690088873452 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690088873504 (+52 ms) 2023-07-23 05:07:53,507 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:53,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 310 msec 2023-07-23 05:07:53,800 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:53,837 DEBUG [Listener at jenkins-hbase4.apache.org/41165] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:53,841 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:53,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 05:07:53,844 DEBUG [Listener at jenkins-hbase4.apache.org/41165] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:53,847 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:53,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33729] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 05:07:53,848 DEBUG [Listener at jenkins-hbase4.apache.org/41165] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:53,851 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:53,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41749] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 05:07:53,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:07:53,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:53,863 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:53,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 05:07:53,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:53,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:53,867 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:53,868 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 empty. 2023-07-23 05:07:53,868 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:53,871 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:53,871 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 empty. 2023-07-23 05:07:53,872 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:53,872 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 05:07:53,901 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:53,904 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 91c7c49d9c125cb7a29e47dcaf1363f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:53,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:07:53,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:53,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 91c7c49d9c125cb7a29e47dcaf1363f0, disabling compactions & flushes 2023-07-23 05:07:53,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:53,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:53,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. after waiting 0 ms 2023-07-23 05:07:53,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:53,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:53,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 91c7c49d9c125cb7a29e47dcaf1363f0: 2023-07-23 05:07:53,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:53,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, disabling compactions & flushes 2023-07-23 05:07:53,933 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:53,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:53,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. after waiting 0 ms 2023-07-23 05:07:53,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:53,933 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:53,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2: 2023-07-23 05:07:53,936 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:53,937 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088873936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088873936"}]},"ts":"1690088873936"} 2023-07-23 05:07:53,937 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088873936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088873936"}]},"ts":"1690088873936"} 2023-07-23 05:07:53,939 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:53,940 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:53,940 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088873940"}]},"ts":"1690088873940"} 2023-07-23 05:07:53,943 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 05:07:53,947 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:53,948 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:53,948 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:53,948 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:53,948 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:53,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, ASSIGN}] 2023-07-23 05:07:53,951 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, ASSIGN 2023-07-23 05:07:53,951 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, ASSIGN 2023-07-23 05:07:53,952 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:07:53,952 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:07:53,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:54,103 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:54,107 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:54,107 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874107"}]},"ts":"1690088874107"} 2023-07-23 05:07:54,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=91c7c49d9c125cb7a29e47dcaf1363f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:54,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874107"}]},"ts":"1690088874107"} 2023-07-23 05:07:54,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:07:54,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 91c7c49d9c125cb7a29e47dcaf1363f0, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:54,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:54,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 05:07:54,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91c7c49d9c125cb7a29e47dcaf1363f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 05:07:54,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. service=AccessControlService 2023-07-23 05:07:54,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. service=AccessControlService 2023-07-23 05:07:54,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:54,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,270 INFO [StoreOpener-2ed87a0b5e7cfbca6e0e2c8c4aba51e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,271 INFO [StoreOpener-91c7c49d9c125cb7a29e47dcaf1363f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,272 DEBUG [StoreOpener-2ed87a0b5e7cfbca6e0e2c8c4aba51e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf 2023-07-23 05:07:54,272 DEBUG [StoreOpener-2ed87a0b5e7cfbca6e0e2c8c4aba51e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf 2023-07-23 05:07:54,272 DEBUG [StoreOpener-91c7c49d9c125cb7a29e47dcaf1363f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf 2023-07-23 05:07:54,272 DEBUG [StoreOpener-91c7c49d9c125cb7a29e47dcaf1363f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf 2023-07-23 05:07:54,273 INFO [StoreOpener-2ed87a0b5e7cfbca6e0e2c8c4aba51e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 columnFamilyName cf 2023-07-23 05:07:54,273 INFO [StoreOpener-91c7c49d9c125cb7a29e47dcaf1363f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c7c49d9c125cb7a29e47dcaf1363f0 columnFamilyName cf 2023-07-23 05:07:54,273 INFO [StoreOpener-2ed87a0b5e7cfbca6e0e2c8c4aba51e2-1] regionserver.HStore(310): Store=2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:54,273 INFO [StoreOpener-91c7c49d9c125cb7a29e47dcaf1363f0-1] regionserver.HStore(310): Store=91c7c49d9c125cb7a29e47dcaf1363f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:54,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:54,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:54,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2ed87a0b5e7cfbca6e0e2c8c4aba51e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65343329, jitterRate=-0.026308521628379822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:54,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91c7c49d9c125cb7a29e47dcaf1363f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67940827, jitterRate=0.012397214770317078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:54,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2: 2023-07-23 05:07:54,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91c7c49d9c125cb7a29e47dcaf1363f0: 2023-07-23 05:07:54,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0., pid=70, masterSystemTime=1690088874265 2023-07-23 05:07:54,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2., pid=69, masterSystemTime=1690088874264 2023-07-23 05:07:54,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=91c7c49d9c125cb7a29e47dcaf1363f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:54,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088874284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088874284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088874284"}]},"ts":"1690088874284"} 2023-07-23 05:07:54,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:54,290 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088874286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088874286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088874286"}]},"ts":"1690088874286"} 2023-07-23 05:07:54,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-23 05:07:54,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 91c7c49d9c125cb7a29e47dcaf1363f0, server=jenkins-hbase4.apache.org,33541,1690088792965 in 181 msec 2023-07-23 05:07:54,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-23 05:07:54,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, ASSIGN in 349 msec 2023-07-23 05:07:54,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, server=jenkins-hbase4.apache.org,33729,1690088792900 in 184 msec 2023-07-23 05:07:54,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-23 05:07:54,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, ASSIGN in 351 msec 2023-07-23 05:07:54,307 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:54,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088874307"}]},"ts":"1690088874307"} 2023-07-23 05:07:54,309 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 05:07:54,319 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:54,319 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 05:07:54,322 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 05:07:54,323 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,324 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,323 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,324 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 473 msec 2023-07-23 05:07:54,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:54,471 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 05:07:54,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 91c7c49d9c125cb7a29e47dcaf1363f0, 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c7c49d9c125cb7a29e47dcaf1363f0, 2ed87a0b5e7cfbca6e0e2c8c4aba51e2], force=true 2023-07-23 05:07:54,509 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c7c49d9c125cb7a29e47dcaf1363f0, 2ed87a0b5e7cfbca6e0e2c8c4aba51e2], force=true 2023-07-23 05:07:54,509 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c7c49d9c125cb7a29e47dcaf1363f0, 2ed87a0b5e7cfbca6e0e2c8c4aba51e2], force=true 2023-07-23 05:07:54,509 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c7c49d9c125cb7a29e47dcaf1363f0, 2ed87a0b5e7cfbca6e0e2c8c4aba51e2], force=true 2023-07-23 05:07:54,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, UNASSIGN}] 2023-07-23 05:07:54,547 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, UNASSIGN 2023-07-23 05:07:54,547 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, UNASSIGN 2023-07-23 05:07:54,548 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=91c7c49d9c125cb7a29e47dcaf1363f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:54,548 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:54,548 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874548"}]},"ts":"1690088874548"} 2023-07-23 05:07:54,548 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874548"}]},"ts":"1690088874548"} 2023-07-23 05:07:54,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 91c7c49d9c125cb7a29e47dcaf1363f0, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:54,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:07:54,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91c7c49d9c125cb7a29e47dcaf1363f0, disabling compactions & flushes 2023-07-23 05:07:54,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, disabling compactions & flushes 2023-07-23 05:07:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. after waiting 0 ms 2023-07-23 05:07:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 91c7c49d9c125cb7a29e47dcaf1363f0 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 05:07:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. after waiting 0 ms 2023-07-23 05:07:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 05:07:54,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/.tmp/cf/32289de277bb4247a2cd9ca44e1e3b71 2023-07-23 05:07:54,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/.tmp/cf/32289de277bb4247a2cd9ca44e1e3b71 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf/32289de277bb4247a2cd9ca44e1e3b71 2023-07-23 05:07:54,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/.tmp/cf/9fdae334bf7e4125bbf52d1710f25b61 2023-07-23 05:07:54,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf/32289de277bb4247a2cd9ca44e1e3b71, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 05:07:54,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 in 37ms, sequenceid=5, compaction requested=false 2023-07-23 05:07:54,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 05:07:54,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/.tmp/cf/9fdae334bf7e4125bbf52d1710f25b61 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf/9fdae334bf7e4125bbf52d1710f25b61 2023-07-23 05:07:54,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 05:07:54,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:54,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2. 2023-07-23 05:07:54,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2ed87a0b5e7cfbca6e0e2c8c4aba51e2: 2023-07-23 05:07:54,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:07:54,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf/9fdae334bf7e4125bbf52d1710f25b61, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 05:07:54,760 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, regionState=CLOSED 2023-07-23 05:07:54,760 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088874760"}]},"ts":"1690088874760"} 2023-07-23 05:07:54,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 91c7c49d9c125cb7a29e47dcaf1363f0 in 54ms, sequenceid=5, compaction requested=false 2023-07-23 05:07:54,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-23 05:07:54,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 2ed87a0b5e7cfbca6e0e2c8c4aba51e2, server=jenkins-hbase4.apache.org,33729,1690088792900 in 217 msec 2023-07-23 05:07:54,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ed87a0b5e7cfbca6e0e2c8c4aba51e2, UNASSIGN in 225 msec 2023-07-23 05:07:54,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 05:07:54,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:54,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0. 2023-07-23 05:07:54,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91c7c49d9c125cb7a29e47dcaf1363f0: 2023-07-23 05:07:54,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:07:54,778 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=91c7c49d9c125cb7a29e47dcaf1363f0, regionState=CLOSED 2023-07-23 05:07:54,779 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088874778"}]},"ts":"1690088874778"} 2023-07-23 05:07:54,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-23 05:07:54,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 91c7c49d9c125cb7a29e47dcaf1363f0, server=jenkins-hbase4.apache.org,33541,1690088792965 in 233 msec 2023-07-23 05:07:54,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-23 05:07:54,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c7c49d9c125cb7a29e47dcaf1363f0, UNASSIGN in 245 msec 2023-07-23 05:07:54,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,883 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 05:07:54,896 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873853.91c7c49d9c125cb7a29e47dcaf1363f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:54,897 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873853.2ed87a0b5e7cfbca6e0e2c8c4aba51e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:54,897 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:54,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, ASSIGN}] 2023-07-23 05:07:54,956 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, ASSIGN 2023-07-23 05:07:54,957 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:07:55,107 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 05:07:55,109 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2f3f240561e9aebd1783f15d57c51a83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088875109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088875109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088875109"}]},"ts":"1690088875109"} 2023-07-23 05:07:55,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 2f3f240561e9aebd1783f15d57c51a83, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:07:55,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:55,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:07:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f3f240561e9aebd1783f15d57c51a83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:07:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. service=AccessControlService 2023-07-23 05:07:55,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:55,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/.regioninfo 2023-07-23 05:07:55,316 INFO [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,317 DEBUG [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf 2023-07-23 05:07:55,317 DEBUG [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf 2023-07-23 05:07:55,318 INFO [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f3f240561e9aebd1783f15d57c51a83 columnFamilyName cf 2023-07-23 05:07:55,354 DEBUG [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] regionserver.HStore(539): loaded hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/32289de277bb4247a2cd9ca44e1e3b71.2ed87a0b5e7cfbca6e0e2c8c4aba51e2->hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf/32289de277bb4247a2cd9ca44e1e3b71-top 2023-07-23 05:07:55,361 DEBUG [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] regionserver.HStore(539): loaded hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/9fdae334bf7e4125bbf52d1710f25b61.91c7c49d9c125cb7a29e47dcaf1363f0->hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf/9fdae334bf7e4125bbf52d1710f25b61-top 2023-07-23 05:07:55,362 INFO [StoreOpener-2f3f240561e9aebd1783f15d57c51a83-1] regionserver.HStore(310): Store=2f3f240561e9aebd1783f15d57c51a83/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:55,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:07:55,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f3f240561e9aebd1783f15d57c51a83; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61463924, jitterRate=-0.08411616086959839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:55,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f3f240561e9aebd1783f15d57c51a83: 2023-07-23 05:07:55,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83., pid=77, masterSystemTime=1690088875264 2023-07-23 05:07:55,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.,because compaction is disabled. 2023-07-23 05:07:55,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:07:55,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:07:55,373 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2f3f240561e9aebd1783f15d57c51a83, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,373 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088875373"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088875373"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088875373"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088875373"}]},"ts":"1690088875373"} 2023-07-23 05:07:55,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 05:07:55,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 2f3f240561e9aebd1783f15d57c51a83, server=jenkins-hbase4.apache.org,33541,1690088792965 in 265 msec 2023-07-23 05:07:55,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 05:07:55,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, ASSIGN in 426 msec 2023-07-23 05:07:55,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c7c49d9c125cb7a29e47dcaf1363f0, 2ed87a0b5e7cfbca6e0e2c8c4aba51e2], force=true in 884 msec 2023-07-23 05:07:55,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:55,624 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 05:07:55,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 05:07:55,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088875625 (current time:1690088875625). 2023-07-23 05:07:55,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:55,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x17daf13b to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:55,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12f12c1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:55,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:55,654 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:55,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17daf13b to 127.0.0.1:59908 2023-07-23 05:07:55,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:55,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x104bc25e to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:55,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5058aa45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:55,710 DEBUG [hconnection-0x4bd2e597-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:55,715 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:55,733 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x104bc25e to 127.0.0.1:59908 2023-07-23 05:07:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 05:07:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 05:07:55,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 05:07:55,740 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 05:07:55,740 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690089475740 2023-07-23 05:07:55,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 05:07:55,744 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:55,744 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:55,746 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 05:07:55,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 05:07:55,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-23 05:07:55,748 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 05:07:55,749 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690089475749 2023-07-23 05:07:55,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,763 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 05:07:55,763 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,764 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 05:07:55,764 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 05:07:55,764 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,764 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,766 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,766 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,766 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,766 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,767 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 05:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 05:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 05:07:55,769 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 05:07:55,772 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 05:07:55,772 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,771 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 05:07:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 05:07:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 05:07:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 05:07:55,772 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 05:07:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 05:07:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 05:07:55,775 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,776 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12ae6643[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:55,779 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 05:07:55,780 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 05:07:55,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 05:07:55,782 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:07:55,782 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. started... 2023-07-23 05:07:55,784 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f3f240561e9aebd1783f15d57c51a83: 2023-07-23 05:07:55,784 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,784 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:55,784 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/32289de277bb4247a2cd9ca44e1e3b71.2ed87a0b5e7cfbca6e0e2c8c4aba51e2->hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf/32289de277bb4247a2cd9ca44e1e3b71-top, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/9fdae334bf7e4125bbf52d1710f25b61.91c7c49d9c125cb7a29e47dcaf1363f0->hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf/9fdae334bf7e4125bbf52d1710f25b61-top] hfiles 2023-07-23 05:07:55,784 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/32289de277bb4247a2cd9ca44e1e3b71.2ed87a0b5e7cfbca6e0e2c8c4aba51e2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 05:07:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 05:07:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 05:07:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 05:07:55,790 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/9fdae334bf7e4125bbf52d1710f25b61.91c7c49d9c125cb7a29e47dcaf1363f0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,815 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. completed. 2023-07-23 05:07:55,815 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:07:55,815 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:55,815 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:55,815 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,816 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 05:07:55,816 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:07:55,824 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 05:07:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 05:07:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:55,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:07:55,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 05:07:55,837 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 05:07:55,838 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:55,838 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:55,838 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,838 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:55,840 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,840 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,840 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,841 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:55,841 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:55,842 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,843 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,845 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,846 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:55,846 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:55,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,851 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,864 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,864 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,864 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,864 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,864 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,865 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,866 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,866 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,866 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:56,047 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:56,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:56,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:56,049 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:07:56,280 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:56,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,349 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:56,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:56,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:56,351 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:07:56,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 05:07:56,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,404 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690088875740Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875864 (+124 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875864Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875887 (+23 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088876326 (+439 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690088876403 (+77 ms) 2023-07-23 05:07:56,407 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 05:07:56,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 663 msec 2023-07-23 05:07:56,851 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:56,853 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853 2023-07-23 05:07:56,853 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33631, tgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853, rawTgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:56,884 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:07:56,884 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1052928084_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,884 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 05:07:56,900 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,983 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,984 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,984 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,985 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,985 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,986 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,986 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,073 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-7173158071205418577.jar 2023-07-23 05:07:57,074 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,074 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,074 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,075 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,075 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,076 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:57,076 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:57,076 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:57,077 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:57,077 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:57,077 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:57,078 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:57,078 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:57,079 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:57,079 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:57,080 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:57,080 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:57,081 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:57,081 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:57,082 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:57,082 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:57,083 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:57,083 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:57,107 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:07:58,686 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:58,689 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 05:07:58,691 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 05:07:58,763 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:58,763 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:59,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:05,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:08,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:11,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:12,912 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:08:12,915 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:08:12,933 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,933 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:08:12,934 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:08:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,935 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 05:08:12,935 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 05:08:12,935 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,936 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 05:08:12,936 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088876853/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 05:08:12,944 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 05:08:12,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088892955"}]},"ts":"1690088892955"} 2023-07-23 05:08:12,956 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 05:08:12,958 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 05:08:12,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, UNASSIGN}] 2023-07-23 05:08:12,961 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, UNASSIGN 2023-07-23 05:08:12,962 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2f3f240561e9aebd1783f15d57c51a83, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:12,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088892962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088892962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088892962"}]},"ts":"1690088892962"} 2023-07-23 05:08:12,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 2f3f240561e9aebd1783f15d57c51a83, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:08:13,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 05:08:13,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:08:13,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f3f240561e9aebd1783f15d57c51a83, disabling compactions & flushes 2023-07-23 05:08:13,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:08:13,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:08:13,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. after waiting 0 ms 2023-07-23 05:08:13,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:08:13,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 05:08:13,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:13,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83. 2023-07-23 05:08:13,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f3f240561e9aebd1783f15d57c51a83: 2023-07-23 05:08:13,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:08:13,131 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2f3f240561e9aebd1783f15d57c51a83, regionState=CLOSED 2023-07-23 05:08:13,132 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088893131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088893131"}]},"ts":"1690088893131"} 2023-07-23 05:08:13,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 05:08:13,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 2f3f240561e9aebd1783f15d57c51a83, server=jenkins-hbase4.apache.org,33541,1690088792965 in 169 msec 2023-07-23 05:08:13,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 05:08:13,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f3f240561e9aebd1783f15d57c51a83, UNASSIGN in 176 msec 2023-07-23 05:08:13,138 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088893138"}]},"ts":"1690088893138"} 2023-07-23 05:08:13,140 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 05:08:13,142 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 05:08:13,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 197 msec 2023-07-23 05:08:13,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 05:08:13,258 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 05:08:13,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,266 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,267 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,268 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,273 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,273 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,273 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,273 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,273 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:08:13,273 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:08:13,273 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:08:13,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:13,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:13,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:13,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,275 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,276 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/recovered.edits] 2023-07-23 05:08:13,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 05:08:13,276 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/recovered.edits] 2023-07-23 05:08:13,279 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/recovered.edits] 2023-07-23 05:08:13,288 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/32289de277bb4247a2cd9ca44e1e3b71.2ed87a0b5e7cfbca6e0e2c8c4aba51e2 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/32289de277bb4247a2cd9ca44e1e3b71.2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:08:13,288 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf/32289de277bb4247a2cd9ca44e1e3b71 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/cf/32289de277bb4247a2cd9ca44e1e3b71 2023-07-23 05:08:13,290 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf/9fdae334bf7e4125bbf52d1710f25b61 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/cf/9fdae334bf7e4125bbf52d1710f25b61 2023-07-23 05:08:13,292 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/9fdae334bf7e4125bbf52d1710f25b61.91c7c49d9c125cb7a29e47dcaf1363f0 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/cf/9fdae334bf7e4125bbf52d1710f25b61.91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:08:13,298 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/recovered.edits/8.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2/recovered.edits/8.seqid 2023-07-23 05:08:13,299 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ed87a0b5e7cfbca6e0e2c8c4aba51e2 2023-07-23 05:08:13,303 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/recovered.edits/8.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0/recovered.edits/8.seqid 2023-07-23 05:08:13,303 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/recovered.edits/12.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83/recovered.edits/12.seqid 2023-07-23 05:08:13,304 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c7c49d9c125cb7a29e47dcaf1363f0 2023-07-23 05:08:13,304 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f3f240561e9aebd1783f15d57c51a83 2023-07-23 05:08:13,304 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 05:08:13,306 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,308 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 05:08:13,310 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 05:08:13,311 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,311 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 05:08:13,312 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088893312"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:13,314 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 05:08:13,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2f3f240561e9aebd1783f15d57c51a83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873854.2f3f240561e9aebd1783f15d57c51a83.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 05:08:13,314 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 05:08:13,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088893314"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:13,316 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 05:08:13,319 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 59 msec 2023-07-23 05:08:13,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 05:08:13,378 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 05:08:13,378 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 05:08:13,384 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088893383"}]},"ts":"1690088893383"} 2023-07-23 05:08:13,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 05:08:13,387 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 05:08:13,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, UNASSIGN}] 2023-07-23 05:08:13,388 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, UNASSIGN 2023-07-23 05:08:13,390 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, UNASSIGN 2023-07-23 05:08:13,391 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9e1c19c9141b3b398b6a624ecf37c7af, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:13,391 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6c5fbe080c6b8eaeaa8b65f43b4d3be0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:13,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088893391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088893391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088893391"}]},"ts":"1690088893391"} 2023-07-23 05:08:13,391 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088893391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088893391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088893391"}]},"ts":"1690088893391"} 2023-07-23 05:08:13,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9e1c19c9141b3b398b6a624ecf37c7af, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:08:13,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 6c5fbe080c6b8eaeaa8b65f43b4d3be0, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:08:13,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 05:08:13,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:08:13,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9e1c19c9141b3b398b6a624ecf37c7af, disabling compactions & flushes 2023-07-23 05:08:13,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:08:13,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:08:13,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. after waiting 0 ms 2023-07-23 05:08:13,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:08:13,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:08:13,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c5fbe080c6b8eaeaa8b65f43b4d3be0, disabling compactions & flushes 2023-07-23 05:08:13,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:08:13,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:08:13,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. after waiting 0 ms 2023-07-23 05:08:13,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:08:13,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:13,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:13,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:13,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af. 2023-07-23 05:08:13,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:13,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9e1c19c9141b3b398b6a624ecf37c7af: 2023-07-23 05:08:13,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0. 2023-07-23 05:08:13,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c5fbe080c6b8eaeaa8b65f43b4d3be0: 2023-07-23 05:08:13,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:08:13,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9e1c19c9141b3b398b6a624ecf37c7af, regionState=CLOSED 2023-07-23 05:08:13,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088893565"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088893565"}]},"ts":"1690088893565"} 2023-07-23 05:08:13,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:08:13,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6c5fbe080c6b8eaeaa8b65f43b4d3be0, regionState=CLOSED 2023-07-23 05:08:13,567 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088893566"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088893566"}]},"ts":"1690088893566"} 2023-07-23 05:08:13,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-23 05:08:13,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9e1c19c9141b3b398b6a624ecf37c7af, server=jenkins-hbase4.apache.org,33729,1690088792900 in 175 msec 2023-07-23 05:08:13,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-23 05:08:13,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e1c19c9141b3b398b6a624ecf37c7af, UNASSIGN in 182 msec 2023-07-23 05:08:13,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 6c5fbe080c6b8eaeaa8b65f43b4d3be0, server=jenkins-hbase4.apache.org,41749,1690088792826 in 175 msec 2023-07-23 05:08:13,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-23 05:08:13,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6c5fbe080c6b8eaeaa8b65f43b4d3be0, UNASSIGN in 183 msec 2023-07-23 05:08:13,575 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088893575"}]},"ts":"1690088893575"} 2023-07-23 05:08:13,577 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 05:08:13,579 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 05:08:13,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 202 msec 2023-07-23 05:08:13,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 05:08:13,686 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 05:08:13,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,695 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,697 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,699 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,701 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,701 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:13,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:13,702 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:08:13,702 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:08:13,703 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,703 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:13,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,705 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,705 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/recovered.edits] 2023-07-23 05:08:13,706 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/recovered.edits] 2023-07-23 05:08:13,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 05:08:13,716 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf/4d26f3ee64044e60babfe075ad2b4428 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/cf/4d26f3ee64044e60babfe075ad2b4428 2023-07-23 05:08:13,717 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf/a2ff83e05aef4c5c895f253c9f728589 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/cf/a2ff83e05aef4c5c895f253c9f728589 2023-07-23 05:08:13,722 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af/recovered.edits/9.seqid 2023-07-23 05:08:13,727 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0/recovered.edits/9.seqid 2023-07-23 05:08:13,727 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e1c19c9141b3b398b6a624ecf37c7af 2023-07-23 05:08:13,728 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6c5fbe080c6b8eaeaa8b65f43b4d3be0 2023-07-23 05:08:13,728 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 05:08:13,732 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,735 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 05:08:13,737 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 05:08:13,739 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,739 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 05:08:13,739 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088893739"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:13,739 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088893739"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:13,742 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:08:13,742 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9e1c19c9141b3b398b6a624ecf37c7af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690088871815.9e1c19c9141b3b398b6a624ecf37c7af.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6c5fbe080c6b8eaeaa8b65f43b4d3be0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088871815.6c5fbe080c6b8eaeaa8b65f43b4d3be0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:08:13,742 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 05:08:13,742 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088893742"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:13,746 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 05:08:13,751 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 64 msec 2023-07-23 05:08:13,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 05:08:13,809 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 05:08:13,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 05:08:13,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 05:08:13,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:13,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 05:08:13,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:13,891 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: hconnection-0x3979b582-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:38934 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3979b582-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1798437466_1 at /127.0.0.1:47134 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:47162 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:36672 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:47164 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=583 (was 438) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=5475 (was 5774) 2023-07-23 05:08:13,891 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 05:08:13,926 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=583, ProcessCount=181, AvailableMemoryMB=5471 2023-07-23 05:08:13,926 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 05:08:13,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:08:13,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:13,933 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:08:13,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 05:08:13,935 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:08:13,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:13,938 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:13,938 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:13,939 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 empty. 2023-07-23 05:08:13,939 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 empty. 2023-07-23 05:08:13,939 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:13,940 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:13,940 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 05:08:13,989 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 05:08:13,992 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cce7c226e409177bfff72c991b65e299, NAME => 'testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:08:13,997 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => aee6aab383ee32dfd363b390887879a7, NAME => 'testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:08:14,023 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:14,023 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cce7c226e409177bfff72c991b65e299, disabling compactions & flushes 2023-07-23 05:08:14,023 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,023 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,023 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. after waiting 0 ms 2023-07-23 05:08:14,023 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,023 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,023 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cce7c226e409177bfff72c991b65e299: 2023-07-23 05:08:14,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:14,050 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:14,050 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing aee6aab383ee32dfd363b390887879a7, disabling compactions & flushes 2023-07-23 05:08:14,050 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,050 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,050 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. after waiting 0 ms 2023-07-23 05:08:14,050 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,050 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,050 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for aee6aab383ee32dfd363b390887879a7: 2023-07-23 05:08:14,053 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:08:14,054 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088894054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088894054"}]},"ts":"1690088894054"} 2023-07-23 05:08:14,054 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088894054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088894054"}]},"ts":"1690088894054"} 2023-07-23 05:08:14,056 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:08:14,057 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:08:14,057 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088894057"}]},"ts":"1690088894057"} 2023-07-23 05:08:14,058 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 05:08:14,062 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:08:14,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:08:14,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:08:14,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:08:14,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:08:14,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, ASSIGN}] 2023-07-23 05:08:14,068 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, ASSIGN 2023-07-23 05:08:14,068 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, ASSIGN 2023-07-23 05:08:14,069 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:08:14,069 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41749,1690088792826; forceNewPlan=false, retain=false 2023-07-23 05:08:14,219 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:08:14,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cce7c226e409177bfff72c991b65e299, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:14,223 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=aee6aab383ee32dfd363b390887879a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:14,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088894223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088894223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088894223"}]},"ts":"1690088894223"} 2023-07-23 05:08:14,223 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088894223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088894223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088894223"}]},"ts":"1690088894223"} 2023-07-23 05:08:14,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure cce7c226e409177bfff72c991b65e299, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:08:14,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure aee6aab383ee32dfd363b390887879a7, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:08:14,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:14,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aee6aab383ee32dfd363b390887879a7, NAME => 'testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. service=AccessControlService 2023-07-23 05:08:14,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cce7c226e409177bfff72c991b65e299, NAME => 'testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. service=AccessControlService 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:14,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:14,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,392 INFO [StoreOpener-aee6aab383ee32dfd363b390887879a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,397 INFO [StoreOpener-cce7c226e409177bfff72c991b65e299-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,398 DEBUG [StoreOpener-aee6aab383ee32dfd363b390887879a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf 2023-07-23 05:08:14,398 DEBUG [StoreOpener-aee6aab383ee32dfd363b390887879a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf 2023-07-23 05:08:14,399 INFO [StoreOpener-aee6aab383ee32dfd363b390887879a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aee6aab383ee32dfd363b390887879a7 columnFamilyName cf 2023-07-23 05:08:14,400 DEBUG [StoreOpener-cce7c226e409177bfff72c991b65e299-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf 2023-07-23 05:08:14,400 DEBUG [StoreOpener-cce7c226e409177bfff72c991b65e299-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf 2023-07-23 05:08:14,401 INFO [StoreOpener-cce7c226e409177bfff72c991b65e299-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cce7c226e409177bfff72c991b65e299 columnFamilyName cf 2023-07-23 05:08:14,401 INFO [StoreOpener-cce7c226e409177bfff72c991b65e299-1] regionserver.HStore(310): Store=cce7c226e409177bfff72c991b65e299/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:14,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,405 INFO [StoreOpener-aee6aab383ee32dfd363b390887879a7-1] regionserver.HStore(310): Store=aee6aab383ee32dfd363b390887879a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:14,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:14,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:14,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cce7c226e409177bfff72c991b65e299; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69667615, jitterRate=0.038128361105918884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:14,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cce7c226e409177bfff72c991b65e299: 2023-07-23 05:08:14,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:14,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299., pid=93, masterSystemTime=1690088894382 2023-07-23 05:08:14,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:14,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aee6aab383ee32dfd363b390887879a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63849616, jitterRate=-0.048566579818725586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:14,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aee6aab383ee32dfd363b390887879a7: 2023-07-23 05:08:14,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7., pid=94, masterSystemTime=1690088894382 2023-07-23 05:08:14,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:14,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cce7c226e409177bfff72c991b65e299, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:14,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,417 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088894416"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088894416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088894416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088894416"}]},"ts":"1690088894416"} 2023-07-23 05:08:14,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:14,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=aee6aab383ee32dfd363b390887879a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:14,417 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088894417"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088894417"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088894417"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088894417"}]},"ts":"1690088894417"} 2023-07-23 05:08:14,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-23 05:08:14,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure cce7c226e409177bfff72c991b65e299, server=jenkins-hbase4.apache.org,41749,1690088792826 in 194 msec 2023-07-23 05:08:14,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-23 05:08:14,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure aee6aab383ee32dfd363b390887879a7, server=jenkins-hbase4.apache.org,33541,1690088792965 in 194 msec 2023-07-23 05:08:14,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, ASSIGN in 358 msec 2023-07-23 05:08:14,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-23 05:08:14,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, ASSIGN in 359 msec 2023-07-23 05:08:14,426 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:08:14,426 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088894426"}]},"ts":"1690088894426"} 2023-07-23 05:08:14,428 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 05:08:14,430 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:08:14,430 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 05:08:14,432 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:08:14,433 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:14,433 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:14,433 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:14,433 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:14,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:14,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:14,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:14,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:14,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 511 msec 2023-07-23 05:08:14,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:14,551 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 05:08:14,551 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-23 05:08:14,551 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:14,556 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-23 05:08:14,557 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:14,557 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-23 05:08:14,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088894560 (current time:1690088894560). 2023-07-23 05:08:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x2c438ae8 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:14,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c73b3cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:14,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:14,576 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:14,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c438ae8 to 127.0.0.1:59908 2023-07-23 05:08:14,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:14,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x127506be to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:14,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2251cad2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:14,585 DEBUG [hconnection-0x39df89c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:14,587 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:14,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:14,593 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:14,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x127506be to 127.0.0.1:59908 2023-07-23 05:08:14,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:14,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:08:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:14,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:14,598 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:14,599 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089494599 2023-07-23 05:08:14,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:14,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:14,600 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:14,600 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:14,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:14,606 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:14,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-23 05:08:14,615 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:14,615 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089494615 2023-07-23 05:08:14,701 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:14,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:14,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:14,702 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:14,902 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:14,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:14,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:14,904 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:08:15,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,059 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 05:08:15,059 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,059 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 05:08:15,059 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:08:15,059 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,059 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,065 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,065 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,065 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,065 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,066 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,066 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,067 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,067 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:15,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,071 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,071 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,083 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,085 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,085 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,085 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,085 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,088 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,088 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,088 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,088 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,088 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,089 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,089 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,091 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:15,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7911dd5c[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:15,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7911dd5c[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:15,112 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:08:15,112 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,115 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,115 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,115 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,116 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:15,116 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:08:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,119 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:15,128 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:15,128 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:15,128 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. started... 2023-07-23 05:08:15,128 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. started... 2023-07-23 05:08:15,130 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cce7c226e409177bfff72c991b65e299: 2023-07-23 05:08:15,134 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,134 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:15,134 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:15,140 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aee6aab383ee32dfd363b390887879a7: 2023-07-23 05:08:15,141 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,141 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:15,141 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:15,199 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. completed. 2023-07-23 05:08:15,199 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:15,199 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:15,199 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:15,199 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,199 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,199 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:08:15,201 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,201 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,201 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,202 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,204 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:15,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:15,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,210 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. completed. 2023-07-23 05:08:15,210 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:15,210 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:08:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:15,211 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:15,211 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,211 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,211 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:08:15,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,212 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,212 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,212 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,212 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:08:15,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:08:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41749,1690088792826': 2023-07-23 05:08:15,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:08:15,223 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 05:08:15,223 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:15,223 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:15,223 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,223 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,226 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,229 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,230 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,232 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,234 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,236 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,237 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,241 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,243 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,241 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,244 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,244 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,244 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,244 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,244 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,244 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,365 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 05:08:15,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,366 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690088894599Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690088895243 (+644 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690088895244 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690088895260 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690088895302 (+42 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690088895365 (+63 ms) 2023-07-23 05:08:15,370 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:15,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 766 msec 2023-07-23 05:08:15,711 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:15,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:15,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:15,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41749] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:15,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:15,728 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:15,728 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:15,729 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:15,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:15,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088895766 (current time:1690088895766). 2023-07-23 05:08:15,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:15,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x5f3986e0 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:15,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@330ccc83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:15,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:15,790 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:15,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f3986e0 to 127.0.0.1:59908 2023-07-23 05:08:15,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:15,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x5c62db37 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fff48dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:15,821 DEBUG [hconnection-0x1ac2fd75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:15,823 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:15,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:15,831 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c62db37 to 127.0.0.1:59908 2023-07-23 05:08:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:08:15,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:15,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:15,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:15,842 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:15,843 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089495843 2023-07-23 05:08:15,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:15,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:15,845 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:15,845 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:15,848 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:15,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:15,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-23 05:08:15,856 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:15,857 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089495857 2023-07-23 05:08:15,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,878 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 05:08:15,878 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,880 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 05:08:15,880 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:08:15,880 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,880 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,882 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,882 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,882 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,882 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,882 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,882 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 05:08:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,883 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,884 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 05:08:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,885 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 05:08:15,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,919 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,919 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,920 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,920 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,920 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,924 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,937 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,927 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,937 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,937 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,937 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,939 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,942 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,942 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71b39b04[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,946 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:15,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:15,947 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:15,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71b39b04[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:15,953 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:08:15,953 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,959 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,959 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,959 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,960 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,960 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,960 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,960 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:08:15,960 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,960 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:15,961 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:15,961 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:15,962 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,962 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,962 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,963 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:15,979 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:15,979 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:15,979 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:15,978 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:15,979 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:15,979 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. started... 2023-07-23 05:08:15,980 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aee6aab383ee32dfd363b390887879a7 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 05:08:15,981 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. started... 2023-07-23 05:08:15,981 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cce7c226e409177bfff72c991b65e299 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 05:08:16,068 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/.tmp/cf/5aef34ef5cb242d2b1b68e12cc6be035 2023-07-23 05:08:16,077 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/.tmp/cf/5aef34ef5cb242d2b1b68e12cc6be035 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf/5aef34ef5cb242d2b1b68e12cc6be035 2023-07-23 05:08:16,084 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf/5aef34ef5cb242d2b1b68e12cc6be035, entries=47, sequenceid=6, filesize=8 K 2023-07-23 05:08:16,086 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for aee6aab383ee32dfd363b390887879a7 in 107ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:16,086 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 05:08:16,087 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aee6aab383ee32dfd363b390887879a7: 2023-07-23 05:08:16,087 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,091 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:16,091 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf/5aef34ef5cb242d2b1b68e12cc6be035] hfiles 2023-07-23 05:08:16,091 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf/5aef34ef5cb242d2b1b68e12cc6be035 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,121 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. completed. 2023-07-23 05:08:16,121 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:16,122 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:16,122 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:16,122 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,122 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:16,122 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:08:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:16,125 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:08:16,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:08:16,148 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:16,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:16,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:16,152 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:08:16,453 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:16,454 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:08:16,469 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/.tmp/cf/37b3a7335c234c68b73768ea69e9463d 2023-07-23 05:08:16,476 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/.tmp/cf/37b3a7335c234c68b73768ea69e9463d as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf/37b3a7335c234c68b73768ea69e9463d 2023-07-23 05:08:16,484 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf/37b3a7335c234c68b73768ea69e9463d, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 05:08:16,485 INFO [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cce7c226e409177bfff72c991b65e299 in 504ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:16,487 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cce7c226e409177bfff72c991b65e299: 2023-07-23 05:08:16,487 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,487 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:16,487 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf/37b3a7335c234c68b73768ea69e9463d] hfiles 2023-07-23 05:08:16,487 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf/37b3a7335c234c68b73768ea69e9463d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,909 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. completed. 2023-07-23 05:08:16,909 DEBUG [rs(jenkins-hbase4.apache.org,41749,1690088792826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:08:16,911 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41749,1690088792826': 2023-07-23 05:08:16,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:08:16,916 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 05:08:16,917 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:16,917 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:16,917 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,917 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:16,918 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,918 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:16,918 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,918 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:16,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:16,919 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:16,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:16,919 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:16,920 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,921 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:16,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,923 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,923 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,923 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,933 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:16,934 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:16,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:16,934 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:16,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:16,934 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:16,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,934 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:16,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:16,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:16,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:16,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:16,935 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:16,935 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:16,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:16,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,935 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,937 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,937 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,937 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,937 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,938 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:16,938 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,938 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:16,938 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:16,938 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,938 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:16,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:16,954 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:16,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:16,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-23 05:08:17,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:17,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 05:08:17,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:17,447 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:17,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690088895843Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690088896934 (+1091 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690088896934Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690088896942 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690088897359 (+417 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690088897445 (+86 ms) 2023-07-23 05:08:17,456 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:17,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.6110 sec 2023-07-23 05:08:17,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:17,956 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:17,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:17,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:17,958 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958 2023-07-23 05:08:17,958 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33631, tgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958, rawTgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:08:17,990 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:08:17,990 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_320017330_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:17,990 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 05:08:17,999 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:18,090 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,091 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,091 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,091 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,092 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,092 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,092 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,195 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-8261760928765347302.jar 2023-07-23 05:08:18,195 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,196 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,196 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,197 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,197 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,198 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:18,198 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:08:18,199 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:08:18,200 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:08:18,200 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:08:18,201 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:08:18,201 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:08:18,202 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:08:18,202 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:08:18,203 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:08:18,204 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:08:18,204 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:18,205 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:18,205 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:18,206 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:18,206 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:18,207 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:18,207 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:18,748 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:08:19,714 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:08:19,717 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 05:08:19,780 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:19,781 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:19,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0006_000001 (auth:SIMPLE) 2023-07-23 05:08:25,862 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0006_000001 (auth:SIMPLE) 2023-07-23 05:08:28,115 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:08:28,118 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:08:28,128 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:28,128 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:08:28,129 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:08:28,129 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:28,129 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 05:08:28,130 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 05:08:28,130 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:28,130 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 05:08:28,130 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088897958/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 05:08:28,136 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 05:08:28,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088908143"}]},"ts":"1690088908143"} 2023-07-23 05:08:28,145 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 05:08:28,147 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 05:08:28,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, UNASSIGN}] 2023-07-23 05:08:28,151 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, UNASSIGN 2023-07-23 05:08:28,151 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, UNASSIGN 2023-07-23 05:08:28,153 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cce7c226e409177bfff72c991b65e299, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:28,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=aee6aab383ee32dfd363b390887879a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:28,153 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088908153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088908153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088908153"}]},"ts":"1690088908153"} 2023-07-23 05:08:28,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088908153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088908153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088908153"}]},"ts":"1690088908153"} 2023-07-23 05:08:28,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure cce7c226e409177bfff72c991b65e299, server=jenkins-hbase4.apache.org,41749,1690088792826}] 2023-07-23 05:08:28,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure aee6aab383ee32dfd363b390887879a7, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:08:28,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 05:08:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aee6aab383ee32dfd363b390887879a7, disabling compactions & flushes 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cce7c226e409177bfff72c991b65e299, disabling compactions & flushes 2023-07-23 05:08:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. after waiting 0 ms 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. after waiting 0 ms 2023-07-23 05:08:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:28,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:28,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:28,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:28,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299. 2023-07-23 05:08:28,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:28,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cce7c226e409177bfff72c991b65e299: 2023-07-23 05:08:28,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7. 2023-07-23 05:08:28,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aee6aab383ee32dfd363b390887879a7: 2023-07-23 05:08:28,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:28,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cce7c226e409177bfff72c991b65e299, regionState=CLOSED 2023-07-23 05:08:28,333 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088908333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088908333"}]},"ts":"1690088908333"} 2023-07-23 05:08:28,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:28,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=aee6aab383ee32dfd363b390887879a7, regionState=CLOSED 2023-07-23 05:08:28,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088908334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088908334"}]},"ts":"1690088908334"} 2023-07-23 05:08:28,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-23 05:08:28,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure cce7c226e409177bfff72c991b65e299, server=jenkins-hbase4.apache.org,41749,1690088792826 in 180 msec 2023-07-23 05:08:28,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-23 05:08:28,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure aee6aab383ee32dfd363b390887879a7, server=jenkins-hbase4.apache.org,33541,1690088792965 in 179 msec 2023-07-23 05:08:28,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cce7c226e409177bfff72c991b65e299, UNASSIGN in 188 msec 2023-07-23 05:08:28,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-23 05:08:28,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aee6aab383ee32dfd363b390887879a7, UNASSIGN in 189 msec 2023-07-23 05:08:28,342 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088908342"}]},"ts":"1690088908342"} 2023-07-23 05:08:28,344 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 05:08:28,346 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 05:08:28,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 210 msec 2023-07-23 05:08:28,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 05:08:28,444 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 05:08:28,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,451 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,453 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,456 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:28,457 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:28,458 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,458 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,458 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,458 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 05:08:28,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 05:08:28,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 05:08:28,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 05:08:28,459 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/recovered.edits] 2023-07-23 05:08:28,460 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/recovered.edits] 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,461 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 05:08:28,467 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf/5aef34ef5cb242d2b1b68e12cc6be035 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/cf/5aef34ef5cb242d2b1b68e12cc6be035 2023-07-23 05:08:28,468 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf/37b3a7335c234c68b73768ea69e9463d to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/cf/37b3a7335c234c68b73768ea69e9463d 2023-07-23 05:08:28,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7/recovered.edits/9.seqid 2023-07-23 05:08:28,472 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/aee6aab383ee32dfd363b390887879a7 2023-07-23 05:08:28,477 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299/recovered.edits/9.seqid 2023-07-23 05:08:28,477 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testEmptyExportFileSystemState/cce7c226e409177bfff72c991b65e299 2023-07-23 05:08:28,477 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 05:08:28,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,485 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 05:08:28,489 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 05:08:28,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 05:08:28,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088908490"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:28,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088908490"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:28,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:08:28,495 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cce7c226e409177bfff72c991b65e299, NAME => 'testtb-testEmptyExportFileSystemState,,1690088893928.cce7c226e409177bfff72c991b65e299.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => aee6aab383ee32dfd363b390887879a7, NAME => 'testtb-testEmptyExportFileSystemState,1,1690088893928.aee6aab383ee32dfd363b390887879a7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:08:28,495 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 05:08:28,495 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088908495"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:28,497 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 05:08:28,499 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:28,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 54 msec 2023-07-23 05:08:28,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 05:08:28,563 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 05:08:28,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 05:08:28,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:28,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 05:08:28,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:28,610 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 759) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:39018 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_110417747_17 at /127.0.0.1:34906 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:36941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-60583846_1 at /127.0.0.1:45958 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4598 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:41165 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3979b582-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:45986 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:45381 from appattempt_1690088801991_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=922 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=615 (was 583) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=4896 (was 5471) 2023-07-23 05:08:28,610 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-23 05:08:28,634 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=615, ProcessCount=181, AvailableMemoryMB=4895 2023-07-23 05:08:28,634 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-23 05:08:28,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:08:28,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,639 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:08:28,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 05:08:28,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:08:28,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:28,642 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 2023-07-23 05:08:28,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:28,643 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 empty. 2023-07-23 05:08:28,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 empty. 2023-07-23 05:08:28,643 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 2023-07-23 05:08:28,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:28,643 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 05:08:28,657 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 05:08:28,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15eeddce37af469836c803be78cb1088, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:08:28,661 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6fd09fed360debcac176a710e6d92590, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6fd09fed360debcac176a710e6d92590, disabling compactions & flushes 2023-07-23 05:08:28,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. after waiting 0 ms 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:28,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 15eeddce37af469836c803be78cb1088, disabling compactions & flushes 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6fd09fed360debcac176a710e6d92590: 2023-07-23 05:08:28,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. after waiting 0 ms 2023-07-23 05:08:28,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:28,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:28,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 15eeddce37af469836c803be78cb1088: 2023-07-23 05:08:28,683 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:08:28,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088908683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088908683"}]},"ts":"1690088908683"} 2023-07-23 05:08:28,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088908683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088908683"}]},"ts":"1690088908683"} 2023-07-23 05:08:28,686 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:08:28,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:08:28,687 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088908686"}]},"ts":"1690088908686"} 2023-07-23 05:08:28,688 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 05:08:28,692 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:08:28,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:08:28,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:08:28,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:08:28,693 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:08:28,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, ASSIGN}] 2023-07-23 05:08:28,696 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, ASSIGN 2023-07-23 05:08:28,696 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, ASSIGN 2023-07-23 05:08:28,697 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33541,1690088792965; forceNewPlan=false, retain=false 2023-07-23 05:08:28,697 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33729,1690088792900; forceNewPlan=false, retain=false 2023-07-23 05:08:28,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:28,847 INFO [jenkins-hbase4:46475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:08:28,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=15eeddce37af469836c803be78cb1088, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:28,850 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6fd09fed360debcac176a710e6d92590, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:28,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088908850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088908850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088908850"}]},"ts":"1690088908850"} 2023-07-23 05:08:28,850 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088908850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088908850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088908850"}]},"ts":"1690088908850"} 2023-07-23 05:08:28,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 15eeddce37af469836c803be78cb1088, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:08:28,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 6fd09fed360debcac176a710e6d92590, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:08:28,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:29,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:29,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:29,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fd09fed360debcac176a710e6d92590, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:08:29,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15eeddce37af469836c803be78cb1088, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. service=AccessControlService 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. service=AccessControlService 2023-07-23 05:08:29,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,013 INFO [StoreOpener-6fd09fed360debcac176a710e6d92590-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,014 INFO [StoreOpener-15eeddce37af469836c803be78cb1088-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,015 DEBUG [StoreOpener-6fd09fed360debcac176a710e6d92590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf 2023-07-23 05:08:29,015 DEBUG [StoreOpener-6fd09fed360debcac176a710e6d92590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf 2023-07-23 05:08:29,015 DEBUG [StoreOpener-15eeddce37af469836c803be78cb1088-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf 2023-07-23 05:08:29,015 DEBUG [StoreOpener-15eeddce37af469836c803be78cb1088-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf 2023-07-23 05:08:29,015 INFO [StoreOpener-6fd09fed360debcac176a710e6d92590-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd09fed360debcac176a710e6d92590 columnFamilyName cf 2023-07-23 05:08:29,015 INFO [StoreOpener-15eeddce37af469836c803be78cb1088-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15eeddce37af469836c803be78cb1088 columnFamilyName cf 2023-07-23 05:08:29,016 INFO [StoreOpener-15eeddce37af469836c803be78cb1088-1] regionserver.HStore(310): Store=15eeddce37af469836c803be78cb1088/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:29,016 INFO [StoreOpener-6fd09fed360debcac176a710e6d92590-1] regionserver.HStore(310): Store=6fd09fed360debcac176a710e6d92590/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:29,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:29,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:29,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:29,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:29,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 15eeddce37af469836c803be78cb1088; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72606724, jitterRate=0.08192449808120728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:29,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6fd09fed360debcac176a710e6d92590; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64649892, jitterRate=-0.03664153814315796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:29,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 15eeddce37af469836c803be78cb1088: 2023-07-23 05:08:29,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6fd09fed360debcac176a710e6d92590: 2023-07-23 05:08:29,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088., pid=108, masterSystemTime=1690088909005 2023-07-23 05:08:29,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590., pid=109, masterSystemTime=1690088909006 2023-07-23 05:08:29,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:29,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:29,024 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=15eeddce37af469836c803be78cb1088, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:29,025 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088909024"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088909024"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088909024"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088909024"}]},"ts":"1690088909024"} 2023-07-23 05:08:29,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:29,026 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6fd09fed360debcac176a710e6d92590, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088909026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088909026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088909026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088909026"}]},"ts":"1690088909026"} 2023-07-23 05:08:29,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-23 05:08:29,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 15eeddce37af469836c803be78cb1088, server=jenkins-hbase4.apache.org,33729,1690088792900 in 174 msec 2023-07-23 05:08:29,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, ASSIGN in 334 msec 2023-07-23 05:08:29,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-23 05:08:29,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 6fd09fed360debcac176a710e6d92590, server=jenkins-hbase4.apache.org,33541,1690088792965 in 173 msec 2023-07-23 05:08:29,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-23 05:08:29,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, ASSIGN in 336 msec 2023-07-23 05:08:29,031 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:08:29,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088909031"}]},"ts":"1690088909031"} 2023-07-23 05:08:29,032 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 05:08:29,034 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:08:29,034 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 05:08:29,035 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 05:08:29,036 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:29,036 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:29,036 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:29,036 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:29,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:29,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:29,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:29,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 403 msec 2023-07-23 05:08:29,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:29,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:29,244 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 05:08:29,245 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-23 05:08:29,245 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:29,248 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-23 05:08:29,249 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:29,249 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-23 05:08:29,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:29,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088909251 (current time:1690088909251). 2023-07-23 05:08:29,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:29,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x3a2bf991 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:29,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21007c73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:29,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:29,272 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:29,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a2bf991 to 127.0.0.1:59908 2023-07-23 05:08:29,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:29,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x000aa2d1 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:29,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65882430, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:29,287 DEBUG [hconnection-0x47c93f16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:29,296 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:29,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:29,304 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:29,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x000aa2d1 to 127.0.0.1:59908 2023-07-23 05:08:29,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:29,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 05:08:29,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:29,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:29,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:29,310 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:29,311 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690089509311 2023-07-23 05:08:29,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:29,313 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:29,313 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:29,314 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:29,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:29,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-23 05:08:29,317 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:29,317 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690089509317 2023-07-23 05:08:29,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,361 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 05:08:29,362 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:29,363 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 05:08:29,363 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 05:08:29,415 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:29,415 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,415 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:29,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:29,416 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:29,416 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:29,416 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:29,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:29,416 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,416 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:29,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:29,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:29,417 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,417 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,418 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 05:08:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:29,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:29,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:29,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:29,424 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:29,424 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:29,424 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:29,426 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:29,426 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:29,426 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:29,432 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,433 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:29,434 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:29,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:29,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:29,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:29,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:29,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c614be6[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:29,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:29,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c614be6[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:29,441 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 05:08:29,441 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:29,443 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:29,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,443 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:29,443 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:08:29,443 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:29,444 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,445 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,445 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:29,447 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:29,447 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. started... 2023-07-23 05:08:29,447 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:29,447 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. started... 2023-07-23 05:08:29,448 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15eeddce37af469836c803be78cb1088: 2023-07-23 05:08:29,448 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:29,450 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fd09fed360debcac176a710e6d92590: 2023-07-23 05:08:29,450 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:29,450 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,450 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,450 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:29,450 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:29,450 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:29,450 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:29,452 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:29,482 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. completed. 2023-07-23 05:08:29,483 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:29,483 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:08:29,487 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,487 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:29,487 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:29,487 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:08:29,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 05:08:29,505 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. completed. 2023-07-23 05:08:29,505 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:08:29,507 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,507 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:29,507 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:29,507 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:08:29,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 05:08:29,513 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 05:08:29,514 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:29,514 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:29,514 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,514 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:29,515 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,515 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,515 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,515 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,515 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:29,515 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:29,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:29,516 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:29,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,517 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,518 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:29,519 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:29,520 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,521 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,521 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,525 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:29,525 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:29,525 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:29,525 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:29,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:29,526 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:29,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,525 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:29,525 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:29,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:29,528 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:29,529 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:29,529 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:29,529 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,529 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:29,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:29,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:29,616 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:29,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:29,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:29,618 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:08:29,681 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 05:08:29,918 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:29,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:29,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:29,920 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:08:29,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 05:08:30,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,045 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690088909311Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088909528 (+217 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088909528Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088909534 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088909963 (+429 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690088910045 (+82 ms) 2023-07-23 05:08:30,048 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:30,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 737 msec 2023-07-23 05:08:30,420 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:30,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:30,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:30,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33729] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:30,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:30,431 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,431 DEBUG [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:30,432 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:30,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088910449 (current time:1690088910449). 2023-07-23 05:08:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x2194c734 to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:30,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fab7d9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:30,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:30,460 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:30,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2194c734 to 127.0.0.1:59908 2023-07-23 05:08:30,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:30,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(139): Connect 0x3319fd2c to 127.0.0.1:59908 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:30,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3433211c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:30,467 DEBUG [hconnection-0x4000e580-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:30,470 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:30,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:30,475 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:30,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3319fd2c to 127.0.0.1:59908 2023-07-23 05:08:30,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:30,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 05:08:30,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:30,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:30,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:30,480 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:30,480 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690089510480 2023-07-23 05:08:30,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:30,481 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:30,482 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:30,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:30,482 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:30,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-23 05:08:30,484 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:30,485 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690089510485 2023-07-23 05:08:30,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,495 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 05:08:30,495 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:30,496 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 05:08:30,496 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 05:08:30,496 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,496 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,498 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:30,498 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,498 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:30,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:30,498 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:30,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:30,499 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:30,499 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,499 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,499 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:30,501 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:30,501 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:30,501 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:30,502 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:30,502 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:30,503 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:30,503 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:30,503 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:30,503 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:30,503 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41749,1690088792826' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:30,504 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,504 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:30,505 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,505 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33729,1690088792900' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9cb257[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:30,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33541,1690088792965' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:30,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9cb257[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:30,509 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 05:08:30,509 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:30,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41749,1690088792826' in zk 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:30,516 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:30,516 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:30,516 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:30,516 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:30,516 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. started... 2023-07-23 05:08:30,516 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. started... 2023-07-23 05:08:30,517 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15eeddce37af469836c803be78cb1088 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 05:08:30,517 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6fd09fed360debcac176a710e6d92590 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 05:08:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41749,1690088792826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:30,527 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/.tmp/cf/29b551c1c56c4ae2b6c24ca016c9fe32 2023-07-23 05:08:30,528 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/.tmp/cf/ccb8ee6e5d534977b5681e538ab4ee2d 2023-07-23 05:08:30,534 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/.tmp/cf/ccb8ee6e5d534977b5681e538ab4ee2d as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf/ccb8ee6e5d534977b5681e538ab4ee2d 2023-07-23 05:08:30,534 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/.tmp/cf/29b551c1c56c4ae2b6c24ca016c9fe32 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf/29b551c1c56c4ae2b6c24ca016c9fe32 2023-07-23 05:08:30,539 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf/29b551c1c56c4ae2b6c24ca016c9fe32, entries=4, sequenceid=6, filesize=5.1 K 2023-07-23 05:08:30,540 INFO [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 15eeddce37af469836c803be78cb1088 in 23ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:30,542 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15eeddce37af469836c803be78cb1088: 2023-07-23 05:08:30,542 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,542 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:30,542 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf/29b551c1c56c4ae2b6c24ca016c9fe32] hfiles 2023-07-23 05:08:30,542 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf/29b551c1c56c4ae2b6c24ca016c9fe32 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,542 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf/ccb8ee6e5d534977b5681e538ab4ee2d, entries=46, sequenceid=6, filesize=7.9 K 2023-07-23 05:08:30,543 INFO [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6fd09fed360debcac176a710e6d92590 in 26ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:30,543 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fd09fed360debcac176a710e6d92590: 2023-07-23 05:08:30,543 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,543 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:30,544 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf/ccb8ee6e5d534977b5681e538ab4ee2d] hfiles 2023-07-23 05:08:30,544 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf/ccb8ee6e5d534977b5681e538ab4ee2d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,562 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. completed. 2023-07-23 05:08:30,562 DEBUG [rs(jenkins-hbase4.apache.org,33729,1690088792900)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33729,1690088792900' in zk 2023-07-23 05:08:30,566 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,566 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:30,566 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:30,567 DEBUG [member: 'jenkins-hbase4.apache.org,33729,1690088792900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:30,568 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. completed. 2023-07-23 05:08:30,568 DEBUG [rs(jenkins-hbase4.apache.org,33541,1690088792965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:30,569 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:30,569 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:30,569 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,569 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:30,569 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33541,1690088792965' in zk 2023-07-23 05:08:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,570 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,570 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,570 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:30,570 DEBUG [member: 'jenkins-hbase4.apache.org,33541,1690088792965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33729,1690088792900': 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33729,1690088792900' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33541,1690088792965': 2023-07-23 05:08:30,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33541,1690088792965' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 05:08:30,577 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 05:08:30,577 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:30,577 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:30,577 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,577 INFO [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:30,582 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:30,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:30,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:30,583 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:30,583 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,583 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,583 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:30,583 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,583 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:30,583 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,584 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:30,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:30,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,585 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,585 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,585 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:30,587 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,587 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,587 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:30,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:30,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:30,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:30,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:30,590 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:08:30,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:30,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,591 DEBUG [(jenkins-hbase4.apache.org,46475,1690088791241)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:30,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:30,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:30,591 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:30,593 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,593 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 05:08:30,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,650 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690088910480Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690088910591 (+111 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690088910591Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690088910596 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690088910608 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690088910647 (+39 ms) 2023-07-23 05:08:30,652 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:30,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 172 msec 2023-07-23 05:08:30,783 DEBUG [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:30,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:30,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:30,785 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785 2023-07-23 05:08:30,785 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33631, tgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785, rawTgtDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785, srcFsUri=hdfs://localhost:33631, srcDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:08:30,817 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366 2023-07-23 05:08:30,817 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1492966840_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,817 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33631, inputRoot=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366, snapshotDir=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 05:08:30,830 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:30,874 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,875 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,875 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,875 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,876 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,876 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,876 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,948 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/hadoop-7212027272778870373.jar 2023-07-23 05:08:30,948 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,948 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,949 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,949 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,949 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,950 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:30,950 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:08:30,950 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:08:30,951 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:08:30,951 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:08:30,951 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:08:30,952 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:08:30,952 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:08:30,952 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:08:30,953 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:08:30,953 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:08:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:30,955 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:30,955 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:30,955 DEBUG [Listener at jenkins-hbase4.apache.org/41165] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:31,436 WARN [Listener at jenkins-hbase4.apache.org/41165] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:08:31,438 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 05:08:31,440 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 05:08:33,181 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:33,181 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:33,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0006_000001 (auth:SIMPLE) 2023-07-23 05:08:33,567 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:33,936 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:08:40,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:42,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:46,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:47,743 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:08:47,743 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:08:47,765 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,765 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:08:47,766 INFO [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:08:47,766 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 05:08:47,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 05:08:47,767 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1974854023_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,768 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 05:08:47,768 DEBUG [Listener at jenkins-hbase4.apache.org/41165] snapshot.TestExportSnapshot(367): hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/export-test/export-1690088910785/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 05:08:47,778 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 05:08:47,785 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088927785"}]},"ts":"1690088927785"} 2023-07-23 05:08:47,787 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 05:08:47,789 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 05:08:47,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, UNASSIGN}] 2023-07-23 05:08:47,793 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, UNASSIGN 2023-07-23 05:08:47,793 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, UNASSIGN 2023-07-23 05:08:47,795 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=15eeddce37af469836c803be78cb1088, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:08:47,795 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6fd09fed360debcac176a710e6d92590, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:08:47,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088927795"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088927795"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088927795"}]},"ts":"1690088927795"} 2023-07-23 05:08:47,795 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088927795"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088927795"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088927795"}]},"ts":"1690088927795"} 2023-07-23 05:08:47,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 15eeddce37af469836c803be78cb1088, server=jenkins-hbase4.apache.org,33729,1690088792900}] 2023-07-23 05:08:47,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 6fd09fed360debcac176a710e6d92590, server=jenkins-hbase4.apache.org,33541,1690088792965}] 2023-07-23 05:08:47,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 05:08:47,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:47,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 15eeddce37af469836c803be78cb1088, disabling compactions & flushes 2023-07-23 05:08:47,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:47,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:47,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. after waiting 0 ms 2023-07-23 05:08:47,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:47,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:47,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6fd09fed360debcac176a710e6d92590, disabling compactions & flushes 2023-07-23 05:08:47,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:47,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:47,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. after waiting 0 ms 2023-07-23 05:08:47,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:48,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:48,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:48,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088. 2023-07-23 05:08:48,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 15eeddce37af469836c803be78cb1088: 2023-07-23 05:08:48,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:48,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590. 2023-07-23 05:08:48,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6fd09fed360debcac176a710e6d92590: 2023-07-23 05:08:48,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 15eeddce37af469836c803be78cb1088 2023-07-23 05:08:48,022 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=15eeddce37af469836c803be78cb1088, regionState=CLOSED 2023-07-23 05:08:48,022 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088928022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088928022"}]},"ts":"1690088928022"} 2023-07-23 05:08:48,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:48,023 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6fd09fed360debcac176a710e6d92590, regionState=CLOSED 2023-07-23 05:08:48,023 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088928023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088928023"}]},"ts":"1690088928023"} 2023-07-23 05:08:48,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-23 05:08:48,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 15eeddce37af469836c803be78cb1088, server=jenkins-hbase4.apache.org,33729,1690088792900 in 225 msec 2023-07-23 05:08:48,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-23 05:08:48,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 6fd09fed360debcac176a710e6d92590, server=jenkins-hbase4.apache.org,33541,1690088792965 in 227 msec 2023-07-23 05:08:48,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=15eeddce37af469836c803be78cb1088, UNASSIGN in 238 msec 2023-07-23 05:08:48,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-23 05:08:48,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6fd09fed360debcac176a710e6d92590, UNASSIGN in 239 msec 2023-07-23 05:08:48,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088928031"}]},"ts":"1690088928031"} 2023-07-23 05:08:48,032 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 05:08:48,034 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 05:08:48,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 257 msec 2023-07-23 05:08:48,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 05:08:48,087 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 05:08:48,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,092 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,093 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,094 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33729] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,098 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,098 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,098 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,098 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,098 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 2023-07-23 05:08:48,098 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:48,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:48,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:48,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:48,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:48,102 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,102 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:48,102 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,102 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:48,102 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,102 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:48,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 05:08:48,103 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,103 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:48,105 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/recovered.edits] 2023-07-23 05:08:48,105 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf, FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/recovered.edits] 2023-07-23 05:08:48,118 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf/29b551c1c56c4ae2b6c24ca016c9fe32 to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/cf/29b551c1c56c4ae2b6c24ca016c9fe32 2023-07-23 05:08:48,119 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf/ccb8ee6e5d534977b5681e538ab4ee2d to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/cf/ccb8ee6e5d534977b5681e538ab4ee2d 2023-07-23 05:08:48,124 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590/recovered.edits/9.seqid 2023-07-23 05:08:48,125 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6fd09fed360debcac176a710e6d92590 2023-07-23 05:08:48,132 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/recovered.edits/9.seqid to hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088/recovered.edits/9.seqid 2023-07-23 05:08:48,133 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/15eeddce37af469836c803be78cb1088 2023-07-23 05:08:48,133 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 05:08:48,135 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,137 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 05:08:48,140 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 05:08:48,141 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,141 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 05:08:48,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088928141"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:48,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088928141"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:48,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:08:48,148 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 15eeddce37af469836c803be78cb1088, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690088908635.15eeddce37af469836c803be78cb1088.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6fd09fed360debcac176a710e6d92590, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088908635.6fd09fed360debcac176a710e6d92590.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:08:48,148 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 05:08:48,148 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088928148"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:48,149 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 05:08:48,151 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 63 msec 2023-07-23 05:08:48,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 05:08:48,205 INFO [Listener at jenkins-hbase4.apache.org/41165] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 05:08:48,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 05:08:48,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 05:08:48,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:48,256 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 761) Potentially hanging thread: hconnection-0x3979b582-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:41982 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3979b582-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5204 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:38623 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:54602 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_725976562_1 at /127.0.0.1:54578 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1974854023_17 at /127.0.0.1:34826 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=592 (was 615), ProcessCount=178 (was 181), AvailableMemoryMB=5094 (was 4895) - AvailableMemoryMB LEAK? - 2023-07-23 05:08:48,256 WARN [Listener at jenkins-hbase4.apache.org/41165] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-23 05:08:48,256 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 05:08:48,268 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:08:52,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088801991_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:53,586 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:09:02,397 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:09:16,522 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 05:09:16,523 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:09:16,636 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 05:09:16,651 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 05:09:16,652 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 05:09:16,685 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:09:16,790 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 05:09:16,790 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 05:09:16,791 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 05:09:16,791 INFO [Listener at jenkins-hbase4.apache.org/41165] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 05:09:16,791 DEBUG [Listener at jenkins-hbase4.apache.org/41165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68214c6c to 127.0.0.1:59908 2023-07-23 05:09:16,791 DEBUG [Listener at jenkins-hbase4.apache.org/41165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,791 DEBUG [Listener at jenkins-hbase4.apache.org/41165] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 05:09:16,791 DEBUG [Listener at jenkins-hbase4.apache.org/41165] util.JVMClusterUtil(257): Found active master hash=1484265873, stopped=false 2023-07-23 05:09:16,791 DEBUG [Listener at jenkins-hbase4.apache.org/41165] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,791 DEBUG [Listener at jenkins-hbase4.apache.org/41165] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 05:09:16,792 INFO [Listener at jenkins-hbase4.apache.org/41165] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:09:16,796 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,796 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,796 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,796 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,796 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:09:16,796 INFO [Listener at jenkins-hbase4.apache.org/41165] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 05:09:16,796 DEBUG [Listener at jenkins-hbase4.apache.org/41165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29be31b4 to 127.0.0.1:59908 2023-07-23 05:09:16,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,796 DEBUG [Listener at jenkins-hbase4.apache.org/41165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,797 INFO [Listener at jenkins-hbase4.apache.org/41165] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41749,1690088792826' ***** 2023-07-23 05:09:16,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,797 DEBUG [Listener at jenkins-hbase4.apache.org/41165] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,798 INFO [Listener at jenkins-hbase4.apache.org/41165] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 05:09:16,798 INFO [Listener at jenkins-hbase4.apache.org/41165] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33729,1690088792900' ***** 2023-07-23 05:09:16,798 DEBUG [Listener at jenkins-hbase4.apache.org/41165] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,798 INFO [RS:0;jenkins-hbase4:41749] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 05:09:16,798 INFO [Listener at jenkins-hbase4.apache.org/41165] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 05:09:16,798 INFO [Listener at jenkins-hbase4.apache.org/41165] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33541,1690088792965' ***** 2023-07-23 05:09:16,798 DEBUG [Listener at jenkins-hbase4.apache.org/41165] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,798 INFO [RS:0;jenkins-hbase4:41749] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 05:09:16,798 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 05:09:16,799 INFO [RS:0;jenkins-hbase4:41749] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 05:09:16,799 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:09:16,799 DEBUG [RS:0;jenkins-hbase4:41749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73ea8013 to 127.0.0.1:59908 2023-07-23 05:09:16,799 DEBUG [RS:0;jenkins-hbase4:41749] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,798 INFO [Listener at jenkins-hbase4.apache.org/41165] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 05:09:16,802 INFO [RS:0;jenkins-hbase4:41749] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 05:09:16,802 INFO [RS:0;jenkins-hbase4:41749] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 05:09:16,802 INFO [RS:0;jenkins-hbase4:41749] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 05:09:16,803 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 05:09:16,803 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 05:09:16,803 INFO [RS:1;jenkins-hbase4:33729] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 05:09:16,803 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-23 05:09:16,803 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 05:09:16,803 INFO [RS:1;jenkins-hbase4:33729] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 05:09:16,803 INFO [RS:1;jenkins-hbase4:33729] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 05:09:16,808 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(3305): Received CLOSE for 4c3ffd061cd23be34f22d11619b827a3 2023-07-23 05:09:16,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 05:09:16,808 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(3305): Received CLOSE for d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:09:16,808 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:09:16,808 DEBUG [RS:1;jenkins-hbase4:33729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x134db092 to 127.0.0.1:59908 2023-07-23 05:09:16,808 DEBUG [RS:1;jenkins-hbase4:33729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 05:09:16,809 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 05:09:16,809 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 05:09:16,809 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 05:09:16,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 05:09:16,811 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 05:09:16,820 INFO [RS:2;jenkins-hbase4:33541] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 05:09:16,820 INFO [RS:2;jenkins-hbase4:33541] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 05:09:16,820 INFO [RS:2;jenkins-hbase4:33541] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 05:09:16,820 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:09:16,820 DEBUG [RS:2;jenkins-hbase4:33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6110cdad to 127.0.0.1:59908 2023-07-23 05:09:16,820 DEBUG [RS:2;jenkins-hbase4:33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,829 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-23 05:09:16,829 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1478): Online Regions={4c3ffd061cd23be34f22d11619b827a3=hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3., d0d3a87f7f99de4f4efc6c8e01032169=hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169.} 2023-07-23 05:09:16,833 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,833 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,833 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 05:09:16,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c3ffd061cd23be34f22d11619b827a3, disabling compactions & flushes 2023-07-23 05:09:16,833 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1504): Waiting on 4c3ffd061cd23be34f22d11619b827a3, d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:09:16,833 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33541,1690088792965; all regions closed. 2023-07-23 05:09:16,833 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:09:16,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:09:16,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. after waiting 0 ms 2023-07-23 05:09:16,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:09:16,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4c3ffd061cd23be34f22d11619b827a3 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 05:09:17,011 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 05:09:17,015 DEBUG [RS:2;jenkins-hbase4:33541] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs 2023-07-23 05:09:17,015 INFO [RS:2;jenkins-hbase4:33541] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33541%2C1690088792965:(num 1690088795224) 2023-07-23 05:09:17,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/.tmp/info/e7bc5ef50b4f495da9a2056830c2dcf7 2023-07-23 05:09:17,015 DEBUG [RS:2;jenkins-hbase4:33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:17,015 INFO [RS:2;jenkins-hbase4:33541] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:17,016 INFO [RS:2;jenkins-hbase4:33541] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 05:09:17,017 INFO [RS:2;jenkins-hbase4:33541] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 05:09:17,017 INFO [RS:2;jenkins-hbase4:33541] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 05:09:17,017 INFO [RS:2;jenkins-hbase4:33541] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 05:09:17,017 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:17,019 INFO [RS:2;jenkins-hbase4:33541] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33541 2023-07-23 05:09:17,019 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 05:09:17,019 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 05:09:17,019 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 05:09:17,019 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 05:09:17,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/.tmp/info/7c38d4cb2b5e4c42aaa2c7ef87d28890 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33541,1690088792965 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:17,030 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:17,031 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33541,1690088792965] 2023-07-23 05:09:17,033 DEBUG [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1504): Waiting on 4c3ffd061cd23be34f22d11619b827a3, d0d3a87f7f99de4f4efc6c8e01032169 2023-07-23 05:09:17,035 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33541,1690088792965; numProcessing=1 2023-07-23 05:09:17,036 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33541,1690088792965 already deleted, retry=false 2023-07-23 05:09:17,036 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33541,1690088792965 expired; onlineServers=2 2023-07-23 05:09:17,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/.tmp/info/7c38d4cb2b5e4c42aaa2c7ef87d28890 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/info/7c38d4cb2b5e4c42aaa2c7ef87d28890 2023-07-23 05:09:17,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7bc5ef50b4f495da9a2056830c2dcf7 2023-07-23 05:09:17,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/info/7c38d4cb2b5e4c42aaa2c7ef87d28890, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 05:09:17,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4c3ffd061cd23be34f22d11619b827a3 in 226ms, sequenceid=6, compaction requested=false 2023-07-23 05:09:17,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/.tmp/rep_barrier/60d688fe602141f7985a91963d70e0a5 2023-07-23 05:09:17,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/namespace/4c3ffd061cd23be34f22d11619b827a3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:09:17,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:17,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:09:17,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c3ffd061cd23be34f22d11619b827a3: 2023-07-23 05:09:17,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690088795947.4c3ffd061cd23be34f22d11619b827a3. 2023-07-23 05:09:17,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0d3a87f7f99de4f4efc6c8e01032169, disabling compactions & flushes 2023-07-23 05:09:17,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:09:17,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:09:17,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. after waiting 0 ms 2023-07-23 05:09:17,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:09:17,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d0d3a87f7f99de4f4efc6c8e01032169 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 05:09:17,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60d688fe602141f7985a91963d70e0a5 2023-07-23 05:09:17,136 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,136 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33541-0x1019092dc0a0003, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,136 INFO [RS:2;jenkins-hbase4:33541] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33541,1690088792965; zookeeper connection closed. 2023-07-23 05:09:17,138 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a11721c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a11721c 2023-07-23 05:09:17,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/.tmp/l/63c4e99aee434322bafec97de868cd27 2023-07-23 05:09:17,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63c4e99aee434322bafec97de868cd27 2023-07-23 05:09:17,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/.tmp/l/63c4e99aee434322bafec97de868cd27 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/l/63c4e99aee434322bafec97de868cd27 2023-07-23 05:09:17,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63c4e99aee434322bafec97de868cd27 2023-07-23 05:09:17,183 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/.tmp/table/78f221708e45467e8bab68689496f105 2023-07-23 05:09:17,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/l/63c4e99aee434322bafec97de868cd27, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 05:09:17,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for d0d3a87f7f99de4f4efc6c8e01032169 in 70ms, sequenceid=18, compaction requested=false 2023-07-23 05:09:17,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78f221708e45467e8bab68689496f105 2023-07-23 05:09:17,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/acl/d0d3a87f7f99de4f4efc6c8e01032169/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 05:09:17,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:17,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:09:17,200 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/.tmp/info/e7bc5ef50b4f495da9a2056830c2dcf7 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/info/e7bc5ef50b4f495da9a2056830c2dcf7 2023-07-23 05:09:17,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0d3a87f7f99de4f4efc6c8e01032169: 2023-07-23 05:09:17,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690088796719.d0d3a87f7f99de4f4efc6c8e01032169. 2023-07-23 05:09:17,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7bc5ef50b4f495da9a2056830c2dcf7 2023-07-23 05:09:17,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/info/e7bc5ef50b4f495da9a2056830c2dcf7, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 05:09:17,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/.tmp/rep_barrier/60d688fe602141f7985a91963d70e0a5 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/rep_barrier/60d688fe602141f7985a91963d70e0a5 2023-07-23 05:09:17,212 DEBUG [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 05:09:17,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60d688fe602141f7985a91963d70e0a5 2023-07-23 05:09:17,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/rep_barrier/60d688fe602141f7985a91963d70e0a5, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 05:09:17,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/.tmp/table/78f221708e45467e8bab68689496f105 as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/table/78f221708e45467e8bab68689496f105 2023-07-23 05:09:17,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78f221708e45467e8bab68689496f105 2023-07-23 05:09:17,224 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/table/78f221708e45467e8bab68689496f105, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 05:09:17,234 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33729,1690088792900; all regions closed. 2023-07-23 05:09:17,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 425ms, sequenceid=131, compaction requested=false 2023-07-23 05:09:17,241 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/WALs/jenkins-hbase4.apache.org,33729,1690088792900/jenkins-hbase4.apache.org%2C33729%2C1690088792900.1690088795213 not finished, retry = 0 2023-07-23 05:09:17,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 05:09:17,263 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:17,263 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 05:09:17,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 05:09:17,264 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 05:09:17,264 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 05:09:17,345 DEBUG [RS:1;jenkins-hbase4:33729] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs 2023-07-23 05:09:17,345 INFO [RS:1;jenkins-hbase4:33729] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33729%2C1690088792900:(num 1690088795213) 2023-07-23 05:09:17,345 DEBUG [RS:1;jenkins-hbase4:33729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:17,345 INFO [RS:1;jenkins-hbase4:33729] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:17,345 INFO [RS:1;jenkins-hbase4:33729] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 05:09:17,346 INFO [RS:1;jenkins-hbase4:33729] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 05:09:17,346 INFO [RS:1;jenkins-hbase4:33729] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 05:09:17,346 INFO [RS:1;jenkins-hbase4:33729] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 05:09:17,346 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:17,347 INFO [RS:1;jenkins-hbase4:33729] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33729 2023-07-23 05:09:17,350 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:09:17,350 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:17,350 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33729,1690088792900 2023-07-23 05:09:17,352 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33729,1690088792900] 2023-07-23 05:09:17,352 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33729,1690088792900; numProcessing=2 2023-07-23 05:09:17,353 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33729,1690088792900 already deleted, retry=false 2023-07-23 05:09:17,353 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33729,1690088792900 expired; onlineServers=1 2023-07-23 05:09:17,412 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41749,1690088792826; all regions closed. 2023-07-23 05:09:17,425 DEBUG [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs 2023-07-23 05:09:17,425 INFO [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41749%2C1690088792826.meta:.meta(num 1690088795604) 2023-07-23 05:09:17,440 DEBUG [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/oldWALs 2023-07-23 05:09:17,440 INFO [RS:0;jenkins-hbase4:41749] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41749%2C1690088792826:(num 1690088795224) 2023-07-23 05:09:17,440 DEBUG [RS:0;jenkins-hbase4:41749] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:17,440 INFO [RS:0;jenkins-hbase4:41749] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:17,441 INFO [RS:0;jenkins-hbase4:41749] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 05:09:17,441 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:17,442 INFO [RS:0;jenkins-hbase4:41749] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41749 2023-07-23 05:09:17,444 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41749,1690088792826 2023-07-23 05:09:17,444 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:17,447 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41749,1690088792826] 2023-07-23 05:09:17,447 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41749,1690088792826; numProcessing=3 2023-07-23 05:09:17,448 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41749,1690088792826 already deleted, retry=false 2023-07-23 05:09:17,448 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41749,1690088792826 expired; onlineServers=0 2023-07-23 05:09:17,448 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46475,1690088791241' ***** 2023-07-23 05:09:17,448 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 05:09:17,449 DEBUG [M:0;jenkins-hbase4:46475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@194513aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:09:17,449 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46475,1690088791241 2023-07-23 05:09:17,449 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46475,1690088791241; all regions closed. 2023-07-23 05:09:17,449 DEBUG [M:0;jenkins-hbase4:46475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:17,449 DEBUG [M:0;jenkins-hbase4:46475] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 05:09:17,449 DEBUG [M:0;jenkins-hbase4:46475] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 05:09:17,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690088794711] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690088794711,5,FailOnTimeoutGroup] 2023-07-23 05:09:17,449 INFO [M:0;jenkins-hbase4:46475] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 05:09:17,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690088794712] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690088794712,5,FailOnTimeoutGroup] 2023-07-23 05:09:17,449 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 05:09:17,449 INFO [M:0;jenkins-hbase4:46475] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 05:09:17,450 INFO [M:0;jenkins-hbase4:46475] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 05:09:17,450 DEBUG [M:0;jenkins-hbase4:46475] master.HMaster(1512): Stopping service threads 2023-07-23 05:09:17,450 INFO [M:0;jenkins-hbase4:46475] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 05:09:17,450 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 05:09:17,450 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:09:17,450 ERROR [M:0;jenkins-hbase4:46475] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 05:09:17,451 INFO [M:0;jenkins-hbase4:46475] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 05:09:17,451 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 05:09:17,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:09:17,452 INFO [RS:1;jenkins-hbase4:33729] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33729,1690088792900; zookeeper connection closed. 2023-07-23 05:09:17,452 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,452 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:33729-0x1019092dc0a0002, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,453 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5dd69aa7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5dd69aa7 2023-07-23 05:09:17,454 DEBUG [M:0;jenkins-hbase4:46475] zookeeper.ZKUtil(398): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 05:09:17,454 WARN [M:0;jenkins-hbase4:46475] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 05:09:17,454 INFO [M:0;jenkins-hbase4:46475] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 05:09:17,454 INFO [M:0;jenkins-hbase4:46475] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 05:09:17,455 DEBUG [M:0;jenkins-hbase4:46475] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 05:09:17,455 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:17,455 DEBUG [M:0;jenkins-hbase4:46475] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:17,455 DEBUG [M:0;jenkins-hbase4:46475] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 05:09:17,455 DEBUG [M:0;jenkins-hbase4:46475] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:17,455 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.15 KB heapSize=449.39 KB 2023-07-23 05:09:17,531 INFO [M:0;jenkins-hbase4:46475] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.15 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c21c06278d8349309eca1a2fd8b8444f 2023-07-23 05:09:17,542 INFO [M:0;jenkins-hbase4:46475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c21c06278d8349309eca1a2fd8b8444f 2023-07-23 05:09:17,546 DEBUG [M:0;jenkins-hbase4:46475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c21c06278d8349309eca1a2fd8b8444f as hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c21c06278d8349309eca1a2fd8b8444f 2023-07-23 05:09:17,552 INFO [M:0;jenkins-hbase4:46475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c21c06278d8349309eca1a2fd8b8444f 2023-07-23 05:09:17,552 INFO [M:0;jenkins-hbase4:46475] regionserver.HStore(1080): Added hdfs://localhost:33631/user/jenkins/test-data/3814be46-b49a-d9f2-30a4-ee8c4c2e0366/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c21c06278d8349309eca1a2fd8b8444f, entries=119, sequenceid=899, filesize=28.4 K 2023-07-23 05:09:17,553 INFO [RS:0;jenkins-hbase4:41749] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41749,1690088792826; zookeeper connection closed. 2023-07-23 05:09:17,553 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,553 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): regionserver:41749-0x1019092dc0a0001, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,562 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegion(2948): Finished flush of dataSize ~373.15 KB/382104, heapSize ~449.38 KB/460160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 107ms, sequenceid=899, compaction requested=false 2023-07-23 05:09:17,562 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7dc6534d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7dc6534d 2023-07-23 05:09:17,564 INFO [Listener at jenkins-hbase4.apache.org/41165] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 05:09:17,564 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:17,564 DEBUG [M:0;jenkins-hbase4:46475] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 05:09:17,591 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:17,591 INFO [M:0;jenkins-hbase4:46475] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 05:09:17,591 INFO [M:0;jenkins-hbase4:46475] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46475 2023-07-23 05:09:17,593 DEBUG [M:0;jenkins-hbase4:46475] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46475,1690088791241 already deleted, retry=false 2023-07-23 05:09:17,696 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,696 DEBUG [Listener at localhost/38613-EventThread] zookeeper.ZKWatcher(600): master:46475-0x1019092dc0a0000, quorum=127.0.0.1:59908, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:17,696 INFO [M:0;jenkins-hbase4:46475] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46475,1690088791241; zookeeper connection closed. 2023-07-23 05:09:17,698 WARN [Listener at jenkins-hbase4.apache.org/41165] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 05:09:17,703 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:17,808 WARN [BP-1864726348-172.31.14.131-1690088787156 heartbeating to localhost/127.0.0.1:33631] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 05:09:17,808 WARN [BP-1864726348-172.31.14.131-1690088787156 heartbeating to localhost/127.0.0.1:33631] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1864726348-172.31.14.131-1690088787156 (Datanode Uuid 259a041a-710b-4b26-ab91-a022c9008268) service to localhost/127.0.0.1:33631 2023-07-23 05:09:17,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data5/current/BP-1864726348-172.31.14.131-1690088787156] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:17,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data6/current/BP-1864726348-172.31.14.131-1690088787156] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:17,813 WARN [Listener at jenkins-hbase4.apache.org/41165] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 05:09:17,841 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:17,842 WARN [632993209@qtp-774605631-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33143] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-23 05:09:17,842 WARN [632993209@qtp-774605631-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33143] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-23 05:09:17,849 WARN [BP-1864726348-172.31.14.131-1690088787156 heartbeating to localhost/127.0.0.1:33631] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 05:09:17,849 WARN [BP-1864726348-172.31.14.131-1690088787156 heartbeating to localhost/127.0.0.1:33631] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1864726348-172.31.14.131-1690088787156 (Datanode Uuid eaac0792-f0d2-432a-9df5-479706923b7b) service to localhost/127.0.0.1:33631 2023-07-23 05:09:17,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data3/current/BP-1864726348-172.31.14.131-1690088787156] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:17,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data4/current/BP-1864726348-172.31.14.131-1690088787156] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:17,852 WARN [Listener at jenkins-hbase4.apache.org/41165] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 05:09:17,859 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:17,893 WARN [BP-1864726348-172.31.14.131-1690088787156 heartbeating to localhost/127.0.0.1:33631] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 05:09:17,894 WARN [BP-1864726348-172.31.14.131-1690088787156 heartbeating to localhost/127.0.0.1:33631] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1864726348-172.31.14.131-1690088787156 (Datanode Uuid a7b35f85-5c59-4b09-a4ef-1430038c87f5) service to localhost/127.0.0.1:33631 2023-07-23 05:09:17,899 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data1/current/BP-1864726348-172.31.14.131-1690088787156] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:17,900 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/48f5f58a-d4fd-9e38-891c-abd5a1cdd866/cluster_c13d8ca7-2c43-877f-6124-423dc390f412/dfs/data/data2/current/BP-1864726348-172.31.14.131-1690088787156] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:17,946 INFO [Listener at jenkins-hbase4.apache.org/41165] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:18,079 INFO [Listener at jenkins-hbase4.apache.org/41165] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 05:09:18,166 INFO [Listener at jenkins-hbase4.apache.org/41165] hbase.HBaseTestingUtility(1293): Minicluster is down